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ON THE THEORY OF SYSTEMATIC SAMPLING, I 
By Wiituiam G. Mapow anp Lituian H. Mapow'” 


1. Introduction. It is no longer necessary to demonstrate a need for the 
theory of designing samples. Many of the policy and operating decisions of 
both government and private industry are based on samples. There has been 
an increasing tendency in government and industry to make use of sampling 
theory.” 

Unfortunately there are still considerable differences between the theory and 
practice of sampling. ‘The origins of these differences are, on the one hand, the ig- 
norance of administrators concerning the practical contributions that samp- 
ling theory can make, and on the other, the lack of sampling theory permitting 
the evaluation of some useful sampling designs. 

Much has been and is being done towards bringing theory and practice into 
agreement.’ Administrators and samplers are each successfully educating the 
others. However, there still exist sampling designs for which an adequate 
theory has not been developed, even though experience indicates that if such a 
theory were developed it would demonstrate the superiority of those designs 
over others for which a theory has been developed. 

Perhaps the major omission of sampling theory today is the lack of any statisti- 
cal method for reaching a decision on whether to take a completely random 
sample of n elements of a population of NV elements, or to take a systematic 


sample, that is, to begin with element 7, and select elements 7,7 + k,---,7a+ 
(n — 1)k, as the sample, the starting point 7 being chosen at random and NV = 
kn approximately.’ It is with respect to this question of whether to take a 
systematic® or random sample that the statistician is in a dilemma because he 
has the alternative of recommending a systematic sampling procedure for which 
no theory exists, or a random sampling procedure that may well vield worse 


1 Bureau of Agricultural Economics and Food Distribution \dministration, U. S. De- 
partment of Agriculture, Washington, D. C. 

2 Presented at a meeting of the seminar in statistics of the Graduate School, U. 8S. De- 
partment of Agriculture, November 2, 1948. 

3 The recognition of the need for statisticians who know sampling theory has resulted 
in courses in sampling being given in some of the colleges and universities. 

4 One need only refer to the recent development of positions, the duties of which include 
giving advice on sampling techniques as well as working in the field of application. 

5 In this paper we will assume that VN = kn. To do away with that assumption would 
not add much in the way of generality while it would require some fairly detailed discussion. 
It may be remarked that when N is not exactly kn, then systematic sampling procedures in 
which all starting points have equal probability of selection are biased, although the bias 
is usually trivial. If N is known this bias can be removed by sampling proportionate to 
possible size of systematic sample. 

6 As we define systematic sampling procedures, a systematic sampling procedure is a 
random sampling procedure in which many of the C% selections of n from N items are ex- 
cluded. 
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results than the systematic procedure. The purpose of this paper is to resolve 
that conflict by providing an adequate theory of systematic sampling. 

In the following sections we present the first parts of our research in the theory 
of systematic samples. Although this research covers both the theory of samp- 
ling single elements and sampling clusters of elements, we shall consider, in this 
paper, the sampling units to be single elements, not clusters of elements. The 
latter problem will be dealt with in a later paper. We shall present the theory 
of systematic sampling both from an unstratified population and a stratified 
population. Formulas for the mean value and variances of the estimates are 
derived. Comparisons with random and stratified random sampling designs 
are made. Furthermore, the estimates of the variances and formulas for ‘“‘opti- 
mum” size and allocation of samples are derived. 

A fundamental part of the analysis is the demonstration that from a knowl- 
edge of the variance of the population’ and certain serial correlations or serial 
variances, can be estimated the variance of estimates based on systematic 
samples. The basic results are: 

a. if the serial correlations have a positive sum, systematic sampling is worse 

than random sampling, 

b. if the serial correlations have a sum that is approximately zero, systematic 
sampling is approximately equivalent to random sampling, and 

c. if the serial correlations have a negative sum, systematic sampling is better 
than random sampling. 


2. The use of a finite population. In this paper we assume, for the calcula- 
tion of the expected values, that we are sampling from a finite population of ele- 
ments even though the size of the population may be large enough to permit the 
use of limiting distributions. Often, this is, mathematically, a matter of choice. 
The same results would be obtained by assuming a correctly defined multivariate 
normal distribution and using the notions of conditional probability. From a 
physical point of view, however, there are several factors that lead to the use of 
the finite population. We are most frequently sampling an existing population 
whose laws of transformation are either unknown or not mathematically ex- 
pressed.” Consequently, the notion of a normal or other specified distribution 
from which we sample and use conditional probability is not part of our thinking 
concerning the physical problem. On the other hand, if we consider the popula- 
tion to be a finite population, and use a table of random numbers to draw our 
sample from the finite population, we are using only mathematics implicit in 
our physical problem. Furthermore, we do obtain a repeatable experiment, 
that of selecting a random number, that we know is in a state of statistical 
control. 

In the usual problems of the theory of random sampling, the number of 


7 By ‘“‘variance of population”’ without further qualification is meant the variance of a 
random sample of one element of the population. 
8 In other words, our population is not in a state of statistical control over time. 
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possible samples yielding different sample means is large enough so that the 
sample means may, with a sufficiently large size of population and sample, be 
expected to be approximately normally distributed. In systematic sampling, 
however, the number of possible sample means is usually very small and even if 
the sizes of population and sample are large, it is difficult to assume a normal 
distribution. Consequently, in our interpretation of the means and variances 
of systematic samples we are led to regard the elements of our populations as 
being the results of single observations on random variables, the distributions 
of which may vary from element to element. The interpretations that we then 
make become interpretations of conditional probability, and if the sizes of 
population and sample are sufficiently large, we can assume that the arithmetic 
mean of each of the possible sample means is normally distributed. 

The theory of svstematic sampling under the assumption of an appropriate 
normal multivariate distribution will be dealt with at a later time. 


3. Definitions. Let the finite population to be sampled consist of N elements, 
Mi, *** he. 

By a sample design is meant the combination of a method of classifving these 
N elements into / classes that may or may not overlap, and a method of select- 
ing one of these / classes, each class having a designated probability of being 
selected. The sampling procedure associated with a given sample design is the 
operation of selecting one of the / classes according to the method stated in the 
sample design. The sample is the particular class obtained by the sampling 
procedure. 

By a random sampling procedure is meant any sampling procedure such that 
if the sampling design vields / classes then the probability of selecting anyone 
of these classes is 1, /. Any sample design having a random sampling procedure 
associated with it is a random sampling design. One of the nonrandom samp- 
ling procedures that is being used is the procedure in which the classes have 
associated to them numbers, called sizes, and the probability of a given class 
being the sample is proportionate to its size.” Other nonrandom sampling pro- 
cedures are doubtless being used. 

By an unrestricted random sampling design for selecting n elements from VV 
elements is meant the sampling design such that there are (), classes, the possible 
selections of n from NV elements, each having a probability of 1/C% of being the 
sample. The associated random sampling procedure might consist in identify- 
ing each class by a number 7, 7 = 1, --- , C?, and selecting a number 7 from a 
table of random numbers. The random sampling procedure might also consist 
in identifying the V elements with numbers 7 = 1, --- , V, and then selecting 
a number j from a table of random numbers, then selecting a different number 7 
from a table of random numbers, and following that procedure until n numbers 


® For a discussion of this problem see the paper entitled, ‘‘On the theory of sampling 
from finite populations,’”? by Morris H. Hansen and William N. Hurwitz, Annals of Math. 
Stat., Vol. 14 (1943), pp. 333-362. 


oa 
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from 1, --- , N without repetition have been selected from the table of random 
numbers. The elements associated with these integers would be a random 
sample. It is easy to see that the two procedures are equivalent. 

A random sampling design that is not unrestricted is said to be restricted. 
There are many types of restricted random sampling designs of which what we 
call systematic designs are only one. Among these restricted designs are 
stratified, cluster, double, matched, polynomial, and other sampling designs, 
ach having been developed as attempts to bring theory and practice together, 
to suggest improvements in practice, and to solve problems arising in practice. 

By a systematic sampling design is meant a classification of the N elements 
into k classes, S;,--- , S,; where S; consists of 7;, Vise, -°** » Vi¢~rm—ye, and a 
random sampling procedure for selecting one of the S;. 

It is thus clear that a systematic sampling design is a type of cluster sampling 
design. It will be shown that the new aspect of cluster sampling introduced in 
systematic sampling is that a knowledge of the order of the elements in the 
population is used to obtain the values of the intraclass correlation coefficient 
and changes in the value of that coefficient as the size of sample changes. 

Sampling designs may involve combinations of random and systematic samp- 
ling designs, as well as random and nonrandom sampling procedures. 

The population from which these samples are drawn may or may not be strati- 
fied and the sampling units may be single elements or clusters of elements. 


4. Bases for selecting among sample designs. From the many sampling de- 
signs that can be constructed in order to obtain desired estimates, one will be 
chosen for use on the bases of administrative considerations, cost, and sampling 
error. It has become customary, on the basis of limiting distribution theory 
and the theory of best linear unbiased estimates to use the standard deviation 
of the sample estimate about the character estimated as the measure of sampling 
error. 

Although in this paper we shall continue this practice, it must be pointed out 
that as more sampling designs are constructed, there is the danger that for some 
of these designs the limiting distribution theory is not valid, and the use of the 
standard error becomes more a matter of custom than the result of analysis. 
This danger is present for systematic sampling designs and is being further in- 
vestigated. 

It is perhaps desirable to remark that bias, consistency, and efficiency are 
properties of the sampling design and estimation functions used, not of the 
particular sample obtained. Any estimate based on a sample will probably 
differ from the character estimated. It is the function of statistical analysis to 
indicate how large this difference may be. 


5. Notation. The letter, P, with appropriate subscripts is used for popula- 
tion, and subpopulations such as strata. 
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The number of strata is denoted by L, and the number of elements in the i™ 
stratum is denoted by V,;. Sizes of sample are denoted by » with appropriate 
subscripts. 

The arithmetic mean of the elements of a population or subpopulation is de- 
noted by # with appropriate subscripts. 

Any particular subclass of a population as defined by the sampling design is 
denoted by S with subscripts. Estimates based on an S with subscripts are 
denoted by 7 with subscripts. 


6. Unstratified systematic sampling, the sampling unit consisting of one ele- 
ment. The values assumed by the subscripts used in this section are given in 
Appendix A. 

Let the population, P, consist of N elements 21, ---,2y. It is desired to 
estimate the arithmetic mean, 7, of P. 


Let? NV = kn, and let the class S; consist of the n elements 27;, Vise, °°- 
Lit+~n—ye- Then, the systematic sampling design for estimating 7 from a sample 
of size n, consists of the k classes, S;,---, S,, and the requirement that the 


sampling procedure be such that the probability is 1/k/, that S; is the class se- 
lected by the sampling procedure. 

Let 7; be the arithmetic mean of the elements of S;, i.e., nF; = x1 + ign + 
see b Pis4in—1yx, and let ¢ be the sample mean, i.e., % = ¥; if S; is selected by 
the sampling procedure. 

In dealing with systematic sampling, we shall have occasion to use both the 
circular and non-circular definitions of the serial correlation coefficients and the 
associated serial variances. 

We shall assume that if h > kn then x, = Xj-%n. This is used in the circular 
definitions. 


Let kno” = >o(a, — 2), 
and let knCin = De — €)(tam — #). 


wits ° eae » ° ,e — ° 2 
Then, the circular definition of the serial correlation coefficient piy iS o pix = 
C,, , Which we shall use unless n is even, when we define pin by the equation 


‘ ’ 
2c Pknj2 = Cine ’ 


in order to simplify the writing of the formula for o; . 


Similarly, if we define the serial variance, s,,, by the equation kns, = >> 
v 
(v1, — Xv), then we are using the circular definition of the serial variance. 


The circular definition of the serial variance ratio v;, is then ov, = sy which 
we shall use unless n is even, when we define vyn/2 by the equation 


26 Vinj2 = Sknj2 » 
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The non-circular definitions of the serial correlations and serial variances are 
given by 


(1) k(n — 5)Ci5 = > (a; — €)(rj4%8 — 2), 
2 


and 
27 , 
oO Uns = Skd5~ 


The intraclass correlation coefficient A; is defined by the equation 
op, = S(q, — £)(x, — 3), 
where the random process consists in first sampling one of the S; at random and 
then selecting two of the z’s at random from the S; that was selected. Then, 


since 
kor = Doki — 2)’, 
1 

and, ; 
(2) op, = (n/n — l)oz — (1/n — I) | 
. 
we have | 
> I " 
(3) oz = -(1 + (n — 1)fx) : 
n 
t 
It is easy to see from (1) that the intraclass correlation coefficient is given by — | 


Pk : Do (n — 4)pis 


n(n — 1) 4 
2 
so 
n= iS 


and that consequently, if n is odd, fj, is the arithmetic mean of the p,, while if 
n is even, j; is equal to the arithmetic mean of the p;, multiplied by n/(n — 1). 

THEoremM’: Using the systematic sampling design, the estimate % is an un- 
biased estimate of &, and has variance o; where 


) 
2 1 “ i 
Oz; = o | ti ya (n - 6 yes > ; 
n- 3 } 
(a -l de | 
= CG —_— — k 
a; 
o 2 a 7 
(4) = —{1+—- 2 (n — d)pise 
n nN 3s J 


= (1+220 om) 


=" {1+ (n= Da. 


10 A proof of Theorem 1 that is somewhat simpler to follow but which, in the authors 
opinion, is not as informative as that given below could be obtained by substituting for 
_ pe Using equations (2) and (3). The lemmas in Appendix B are, of course, of interest in 
themselves in finite sampling. ' 
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ProoF: From the definitions of expected value, 7; , ¥, and the systematic samp- 


ling design, it follows that 7 is a variate with possible values 7,,--- , %,, the 
probability that 7 = 7; being 1/k. Then 

(5) kO% = Ftee- +H, 

and, when the values of the 7; are substituted in (5), it follows that Gi = 2, 


that is, Z is an unbiased estimate of Z. 

Having calculated Gi, it is necessary to calculate G¥ in order to evaluate 
o;. From the definition of expected values, it follows that 
(6) k6# = Zi +--+. + 4, 


and when the values of the 7; are substituted in (6), it follows that 


(7) i = 7 Vi+(a—-Ik Vi4(y—Dk 


1,a,¥ 


Then, when f(u) is replaced by u in Lemma 6 of Appendix B, it follows, from 
ai - 9 l 9 l 
the definition of the variance, that o; = ©) >, @ — 2f - (4) > (t; -— 
v v cn 5,7 


2 2 l wf 
Ti+) =o — n? Da(n — 0)8K5 
o 


follows that 


and when f(u) is replaced by u in Lemma 8, it 


Q 
hi bo 


2, 2 
() c+, > (n — d)exs . 
n n> °F 
If in Lemma 9 of Appendix B we now replace f(x;, 2j+%8) by (vw; — xj428)° 
2 1 
then o; = o — (:) y Sku 5 
and if we replace f(x; , 2 j+«3) by (vj — £)(tj4n8 — Z) then 
(co + 2>, Ci) 
B 


9 
g:; = 


Finally, we have, then 


and 
2 o 
o: = —(1+2)) pm). 
nv he 
7. Possible values of the o;;, .,ando;. Let us investigate briefly the effects 
. . . , 2 - 9 7 
of different patterns of variation on the values of p;s and o;. Now ops = 


Sa > (x; — ®)(xjres — F). Suppose that <; = riszs,5 = 1,--- ,n — i, 
k(n — 6) j 
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7=1,---,k. Then > (4, —% =n » (a; — ¥)°, and d(x )(x 5448 — #) 
= (n — 5) Zz (x; — #)°. Upon ecbetivation it follows that prs = 1,anda; =o". 


This result for o; is intuitively clear, since all the variability is among the 
possible samples, and thus any particular systematic sample is equivalent to 
one observation. 

Suppose, on the other hand, that 2340 = Ti+ 8= » 
n—1. Then X (x, -#)° =k Xu (tisca-yx — £) for any 7,7 = 1, a oni 


he (25 — ities —i)=k a (isa-ne — F)(Lisaseye — ¥). Furthermore 
d 
7 (do (Vis(a-yk — F)P = r (Lit+(a-1yk — F) +2 ie (Lisaepk — F)(Lisage-ne 
a a A, 


— £). Hence 
n—6 1 2 
22 —— ps = —1 and o;=0. 


It is possible to construct examples in which any particular prs = — 1, but in 
such cases the remaining ins each vanish. It is well known that the minimum 
value of p, is — 1/(n — 1). 

Finally, let us consider the expected values of pis and o; if the x’s have been 
assigned their subscripts at random. These values are pis = —1/(nk — 1) 


> 
le? o (nk — n 

and oz = —{ - ; 
? n\nk -— 1 


In most practical applications of systematic sampling it will be highly unlikely 
that the distribution of the z’s will be such that the x’s may be said to have been 
assigned their subscripts at random. In general, there will be logical reasons 
to expect that the 2’s will have some fundamental trend. Thus, information 
will often be available, or may be obtained by a small subsample, on the basis 
of which a decision can be made to use some approach differing from that of 
assuming the subscripts of the z’s to have been assigned at random. 


8. Estimates of the parameters. The formulae obtained in section 6 for the 
variance of the mean of a systematic sample are population formulae. Their 
values depend on the values of all the elements of the population. However, 
even in tests of possible sampling procedures, we rarely have available the re- 
sources with which to study the entire population. Consequently, it becomes 
necessary to investigate the possibility of estimating the population variances 
and serial correlations from samples. It will be shown that the estimates of the 
variances and correlations derived from a single S, are biased and inconsistent 
whereas it will be possible to construct unbiased or consistent estimates from 
samples of more than one of the S;. The sampling variations of these estimates 
must be left for further study. 

Let us assume that instead of sampling only one of the S; , as we did in section 
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6, we sampled g of the S; at random. Then our sample would consist of all the 
elements in the S;. The sample mean, @, is defined by 
gt = >. ip 
B 

if the subscripts 0% our sample classes are 7; ,--- , %. 

Then it is easy to see that * is unbiased Furthermore, since we can regard 
this sampling procedure as the sampling of g of k elements at random, it follows 

2 k- 1 2 2- : ll 
that o; = i 4 — o; and, we have evaluated o; in section 6. 
rk —1g 
Since 


wbo 


koz = Do (a — 2)’, 
t 
we shall consider estimating oz by s; where 
a > «\2 
g3; = Du (# — 4)’. 
8 


9 


Now, since FE # = o3 + #, and 
> 
yy x a a a : =" 
£2,%3 = Ee Fi = g(o: + ©) 
0 vu v 


it follows that Gs? = o; , and hence s; is an unbiased estimate of o;. Further- 


o2 glk — 1) 
more Gs; = J a. 
k-g 
We now turn to estimates of the p;, and o. 
Let 
gns; = Zz (T2¢(a-ye — £) 
3,a 
and let 
Neng = Dy (*aza—ve — £)(T24catu-ve — 4). 


J.a 


Then, it may be shown that 
and 

Hence 

11 Tt may be wondered why we sample these S; at random rather than systematically. 
If we sampled the S; systematically, it would be equivalent to taking a single systematic 


sample having smaller intervals between elements of the sample. Furthermore, we could 
not derive the unbiased estimates of the sampling variance that we can now. 
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ca ” k = y 
ere & = ) ne 


The estimate, 7, , Of px, defined by 


., 2 :- q ste a a -- g ) 
=e (= - ) _ lé =” (su = a | 


is thus biased but in many eases the bias will be small Of course, if u = 


and 


n 


2 
when n is even then r;,/2 is multiplied by 2 to estimate p;.,.;2 as previously defined. 
Another approach would be to consider 


gn wSg = » (13+(e—1)k = tg) ’ 
p,a 
and 
qn ie = ze (1341a—1k — Fg) (ps a+p—1)k Fe). 
Bra 


When that is done, it follows that 


- 42 2 > 


G8, =O — G3, 
and 
CS “ 
Ovlkyg = Ce “= OZ ;j 


and 


Another estimate of p;, is thus defined by the equation 


9 9 


whing + Sj = wu Puhull, + 85]. 


9 


When g = 1, s; = 0 and we are unable to provide unbiased estimates of o’, 
Ci , and o; from the sample. However, since 


- Tee 8) Sed Ckug 
: ie a2 a . ’ 
= Vip’ Sg — Cky’g 
it follows that approximately 
1 — pm _ co 1 Mw 
: = & a 


1 — pry l= Ty 


since G[S) — Cig] = o — Cy. Similar equations hold for the urn. 


ee Rn NEE TR RETR IT pe me 


ex een ea NEE TT RET Te eT 


eee 


RTE 
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y . / . . — ° . 
When we estimate the p,; , then the “within class’’ definition is simpler. Let 
/ / pe aig 
k(n — 8)wlksg = 7 (Visa—ne — w%i)(Tisags-ye — 2%i), where 
tr 


(n — d)uti = D) Tizane, 
A 


(n — det; = 7 Lit(vA+5—k 5 
A 


and let 
° af - =- \ 
gn — 6)xbisg = = (t24a—yk — 18% 2)(Xe+a4e—vi — 268s). 
BN 
Let 
/ a a as “i 
ICisg = z (ut; — Z)(xt; — Z), 
v 
and let 
ger, = Do (wis — #)(es¥3 — 2), 
B 
Then 
, , / 
Ces = uCkig + wCkdg . 
and 


~ a’ a’ / 
&(wlkdg + Cbg) —_ Crs . 
rp : e , e , 1 
Thus, as estimates of the p;3; we obtain 7,3 where 
at af ' 2 2 
ulkig + wCrdg = Tk5(wSy + 83). 


a ° ° . / 2 in 
In cases where 7 ix known simpler estimates of the pi, , xs , and o” may be easily 
obtained since 


c 


&> (134 (ak — F)(Xep(atu—yk — T) = QnCu , 


3,a 
Co F = \ = y/ 
62 (t3-a-ne — F)(Ta+a+s-ye — #) g(n—5)C xs , 
Doi 


and 


SD. (x4ca-yk — #)” = gno’. 
S,a 


Thus, in pilot studies, when 7 is known it is possible to estimate the param- 
° 2 ‘ 
eters in o; from even a single sample. 


§. Changes in the variance with changing size of sample. The chief reasons 
for expressing the variance of a systematic sampling design in terms of the 
variance of a random sample and the serial correlation coefficients were 

1. To enable the making of comparisons with random and other sampling 

designs 
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2. To simplify the analysis of causes for the difference in the efficiencies of the 

systematic and random designs, and 

3. To simplify the making of estimates of the variance for different sizes of 

sample. 

In this section we are concerned with the third of these reasons. We shall 
discuss only the p;, since the analysis in terms of the p;; is very similar. 

The problem with which we are concerned is the estimation of the function, 
px, of k. In order to show how this may be done for all values of k when the 
px, have been computed for one value of k, let us first note that since o° does 
not depend on k we may confine our considerations to the C,,. In section 6 
we have defined C;, by the equation 


knCin = do (tv — ¥)(2r4% — 2). 


Thus, if we wish to evaluate the C;:,' where k’ is such that k’ ¥ k and k’n’ = 
kn = N, we have the result Cy, = Cy, if k’u’ = ku and, thus, for any given 
pe oe ? < 
values k’ and uw’, we have 


Cer —_ Ch ky’ pk 
k'p’ 
where we have replaced » by _* 

This procedure will involve, if k’ < k, some interpolation, but if the p,, are 
plotted against u, this interpolation may often be carried through graphically. 
However, it is usually advisable to take k so that the possible values of k’ are 
such that k’ > k. 

In some cases it may be possible to construct a correlation function. For 
example, if the x, may be represented by a polynomial in rv, then p;s may be 
represented by a polynomial in 6. From that fact we conclude that if the 2, 
vary about a smooth trend the p;5 will also vary about a smooth trend and it 
may be possible to interpolate. Further investigation of this problem is neces- 
sary. 


10. Stratified systematic sampling. In sampling practice it is customary to 
deal with stratified populations. The variance of an estimate based on a 
stratified population will usually not include the variability among the strata. 
Consequently, when a population is well stratified the variability of estimates 
based _ sample of size n will usually be considerably, less than the variability 
of an esimate based on a random sample of size n, ignoring the strata. We 
now dis‘uss the theory of systematic sampling from a stratified population. 

Let us assume that the population, P, consists of L strata, Pi,---, Pr, 
the ath of which contains N, elements ta1,--- , Zan, . It is desired to estimate 
the arithmetic mean, ¢ of P. Let the arithmetic mean of P, be denoted by 
%. tN, = bn. 

We shall consider two possible cases, the first of which is often used because 


TE 
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of the administrative simplicity of giving identical operating instructions to the 
people selecting samples in different places. The results of this section will 
indicate when this method may be used. 

Sampling Procedure 1—Suppose that ki = k, = ---k, = k, and that the 
sampling procedure consists in selecting one of the integers, 1, --- , k at random, 
each integer having a probability 1/k of being selected. Then, if the integer 
selected is, for example, 7, the sample of P, consists of tai, Caisk, °° * 5 Lais(ne—Dk - 
Thus, there are exactly k possible samples, 8; , --- , S; , each having probability 
1/k of being the actual sample obtained by performing the sampling procedure. 

Sampling Procedure II—The sampling procedure consists in selecting one of 
the integers 1, --- , ka at random, for each value of a, each integer having a 
probability of 1/ka of being selected. Then, there are exactly ki - --- - kz 
possible samples, each having probability 1/h,- --- - k, of being the actual 
| sample obtained by performing the sampling procedure. 


Other sampling procedures for stratified sampling, of course, exist. The two 
listed above, however, cover most practical problems except those involving 
cluster sampling. These will be treated in a later paper. Furthermore, from 
the conclusions derived concerning these procedures it will be possible to infer 
conclusions concerning other stratified sampling procedures. 

Let S.; be the class of elements 2a; , Yaisk, °** 5 Vais(ne—1yk- We consider 
sampling procedure I. A systematic sample of size n, is to be selected from P, . 

The possible samples are S,, --- , S; where S; consists of all the elements in 
Sii,-::, Sri. Let the arithmetic mean of the elements in S,; be denoted by 

, ! Z.i. Let the arithmetic mean of the sample from P, be denoted by %, and let 
the sample mean be denoted by Z%, where 


, Ni = Nii + --- + NZ. 
"| Then NEF = DNS = DN, ; > s., = NE. 
- It follows from Appendix C, that 


oF = x x Na Nz Cz,z, 
where 
02,2, = &(%a — Fa)(%s — 4) 

a 1 ‘ 
\" = k dX (Zoi = Fa) (Xi — i). 
e 

Although the expression for o;,z, can be further simplified, the important fact 
; is that if corresponding items in different strata are positively correlated, it is 
e . inadvisable to use sampling procedure I unless other considerations than sampling 
y error are dominant. But if the corresponding items are negatively correlated 


then sampling procedure I will yield a smaller variance than sampling proce- 
dure IT. 
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We now consider sampling procedure II. The difference between sampling 


procedures I and II is that in sampling procedure II we know that o;,:, = 0, 
if a ~ b because of the separate selection of sample in each stratum. Thus, 
1 


. N°oz, where o;, has been derived in 


under sampling procedure II, o; = ‘2 
i¥~ a 


section 6. 


11. A comparison of the efficiences of systematic and random sampling 
procedures. The study of any sampling technique is incomplete unless some 
comparisons are made with other possible sampling techniques. In this section 
the systematic sampling procedure is compared with the unrestricted random 
and stratified random sampling procedure. 

The means and variances associated with the random and stratified random 
sampling procedures will be denoted by the use of primes (’) and double primes 
(’’) respectively. 

Then we know that 


om & kn — 1 
o;/07' = (1 +2 z= Pin) ( : ) 
: kn — n 


and consequently o; < a? if 


2 Pku < —(n — 1)/2(kn — 1). 


If n is large relative to k, we may use —3k as an approximation to 
—(n — 1)/2(kn — 1). 

In order to make more specific comparisons, it is useful to assume that the 
population elements .r, are given by some function of v, and to assume some func- 
tions such as 


a Ap + Ary + vee bA,D’, 


or 
2 Ser 
x, = Bo+ A; sin = + B, cos — 
N N 
2rhv 2rhv 


+ A, sin V + B, cos vo 


and then to investigate the efficiencies of the various possible sampling proce- 
dures on the bases of such assumed distributions of the x,. It should be noted 
that the use of the systematic sampling technique involves the assumption that 
it is possible to order the elements of the population in a logical way, and then 
use this ordering in selecting the sample systematically. 

We shall now consider several possibilities. Let us first note that if we are 
sampling but one element from a stratum then the variance of the stratum 
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sample mean is the same whether the sampling is random or systematic. On 
the other hand, it follows from section 10 that if we stratify the population into 
L strata so that a systematic sample of size L chooses the jth element of each 
stratum, say, then the variance of the mean of the stratified random sample will 
be greater or less than the variance of the mean of the systematic sample de- 
pending on whether the average correlation between strata sample means in the 
systematic sample is negative or positive. 

Let us now consider the origin of the warnings against the use of systematic 
samples from a population having a periodic distribution. If k is the period, 
the correlation between the strata means of the systematic sample is +1 and 
hence the random sample is superior. However, if the period is 2k then we 
shall show that the systematic sample will probably have a smaller variance. 

Suppose that the period is 2k and that within two adjoining strata of size k 
we always have 2) = wo; , C2 = Vor, ¢°* 5 Ue = Mea and xa; — F = — (xpi — F). 
Then, if we are sampling one element from each stratum, the correlation between 
the systematic sample means, (the individual elements in this case), will be —1 
if the strata subscripts differ by an odd number and +1 if the strata subscripts 
differ by an even number. 

The variance within each of the n strata is oj , where 


= : (2; —_ zy’. 


The variance between strata means is zero. Hence o = o;. The variance 
of the mean of an unrestricted random sample of size n where n = L is then 


. ¢ 


vo 


eto 


9 N ow. L o; . ° “ce . . 
a7 = Vv 17 and the variance of the stratified random sampling mean is 
9 ; 2 ° e . . . . 
oz = (1/L)o; while the variance of the systematic sampling mean is 


o 


i 


2 L 
=D (-1)°7 — 64) 
i? Gas 

where 6;; = lif 7 = j and 6;; = Oif 7 # j. 

Then it may be shown that if L is even c” = 0 while, if L is odd o” = (1/L’)o} . 

Consequently, the efficiency of the systematic sample mean is greater than 
the efficiency of the stratified random sample mean if the population has a 
periodic distribution and the size of stratum is half the period. It should be 
noted that the same situation holds for k equal to an even or odd multiple of half 
the period as held for k equal to the period of half the period. 

The situation is quite different if we assume that the elements of the popula- 
tion have a straight line distribution. Without loss of generality, we may 
assume that the straight line distribution is given by x2, = v. Then for an 
unrestricted random sample of size n, the sample mean being denoted by 2’ 
we have Gi’ = * = 3(kn + 1), 


2 kn’ — 1 
12’ 
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and 
» _ (k — 1)(kr + 1) 
Oo; = ; 12 : rs 
For a stratified random sampling design, let us assume that Ny; = --- = 
Ni = 9 where c may equal any of the integers 1, 2,--- ,n;ie. L = - . bat 
m= +--+ =n,=c. Theng; = al > o; where %” is the sample mean of 


nck —1°9 
the stratified random sample. If the ath stratum contains x, Zen 


n 


cN oe 
a—1l)—-+1 ’” 
n 


272 9,9 
° ck — 2 c k — 1 ck — |] : 
hen o, = and 3, = —- . Finally 
then a; 12 and o; ae nite inally 
a3 =o - a mi } “i= Li4i5)” 
nt “Ty *; 
— k(n? — 1) 
— oO — _ 12 - 
ke — 1 


To summarize 


2 _ (k — 1)(kn + 1) ” (k — 1)(N + 1) 


—_— 12 12 , 
N ) 
7 | ae NE he 
» ek — (ck #1) _ wm 5 ; 
12n ~ 121 ' 
nf 
~~ 


2 ae Lik os 1) 


It is clear that both ¢: and o:-- are less than o;.. However ¢o3/¢3- 


N 
= l 
L + 
a r . . N 2 $ “en a 
Since kn = N and cL = n it follows that k = — and hence o; < a;- if N > 
cL 
L ; ; : 
L(L — 1) ande > Ld 1): In all cases N > c. It follows therefore 
i- L 
‘N 
y . N NL ’ 
that for a value of c to exist we must have — > as a result of 


L N — L(L — 1) 
which we find that N must exceed 2L7 — L. Hence a; < az if N > 21> — L 
L 
a. 
and c > a = % 
l — iN 


z 


Otherwise o; > a3. 
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This result follows from two facts: 

(1) If one element is being taken from each stratum then the high average 
correlation between strata means results in the efficiency of the stratified random 
sampling mean being greater than the efficiency of the systematic sampling mean, 
despite the equal within stratum variances. 

(2) If more than one element is being taken from each stratum then the within 
stratum variance of the systematic sampling mean is less than the within stratum 
variance of the stratified random sampling mean and if the size of stratum and 
sample from stratum are large enough, the smaller within stratum variance of 
the systematic sample more than compensates for the correlation among strata 
means. 

Of course, in a straight line distribution there are much more efficient methods 
of defining a stratified random sample than that we have used. Furthermore, 
more efficient sampling procedures than those discussed are available. How- 
ever, this example will be of use in indicating the general probiems that arise 
as well as the procedures that may be followed in attacking them. 

Another comparison of systematic and stratified random sampling may be 
obtained by considering the x, to be composed of two elements, a trend function 
and a periodic function so that the deviations from the trend constitute a 
periodic function. 

Let x, = ¢i(v) + ¢e(v), where ¢:(v) is a trend function and ¢2(v) is a periodic 
function of period 2h, VN = 2hqQ. 

Let go(v) = yy. Then y; = Yyourjy = *** = Yre-yij,j = 1,°--, 2h and 
Yrrarj§ — Y = —(Yrorn+j — 9),J = 1,---, h,a=0,---,Q—1. 

Since the sizes of sample that we shall consider for purposes of this comparison 
are all multiples of h we shall calculate our variances and covariances so that we 
obtain all the necessary information at once. 

Let the mean of g:(v) be denoted by ¢ and let the mean of go(v) be denoted 
by 7. Then 7 = @ + 7 and 


No’ = >> (2, — 39 

X ley) — el + L(y — GH) +2 Dial) — al@ - 9) 
2, (¢ia-nsi — Sia) +h X (Gia — e1)” 

+ 2D. (Ye-vasi — Go)" +h Ga — 9)" 

+ > [yia—yn4i — Pral(Yia-ngi — Ja) +h a (Zia — $1) (Ja — §) 


a,t 


Il 


where a = 1, --- ,2Q;7 = 1,--+,h, Qa is the arithmetic mean of gitca—ynin , 
“++, Gian) and J, is the arithmetic mean of Yca—1n41, °** 5 Yar - 
It follows from the assumptions with respect to the y, that 7. = 9 and that 
h 
z (y; — Ga)” is the same for each value of a and is equal to >> (y; — 9)’. 
- 


t=1 
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Since Yi = Yor+i = 
we have 


h Q 
: [yi (v) oe ally = 9) = Zz. (yi — 9) Zz [ O1(2a—2) h-+i — Piza-2] 
> 


i=1 a=1 


° = Yor (Q—i) +i and Ynti a Yan+i = oS Y2h(Q—-1) +h+i 





2h Q 
+ Z. (yi — 9) pw Leic2a—2)n41) — Pr2a—sl. 
i=h+1 a=1 
Since yi — §¥ = (Yisn — J), We also have Dd [er(v) — aly -— 9) = 


v 


h QV ) 

z (yi — 9) {5 ler((2Qa — 2)h + 2) — g((2Qa — Ih + i) — Qiao + 120-1] } 
i=] \a=1 ) 
which vanishes for example if ¢i(v) is a straight line or if ¢;(v) is a succession of 
straight lines each having length 2h. 


Let us now assume that ¢gi(v) = A+ By. Theng, = A+B | —Ih+ 
A-+1 
i : 


gi((a — 1)h + 7) 


2 BW 
> lea — 1)h + 2) — Gul’ =- i ; 


Xe Gu — a) = BEES = YE 


71 


12 , 
guniAee 2h + 1 
2 
. Fw 
E (a) - a) = a 4NQ? — 1). 






vw 9 9 B’ 9 ~° 9 gis ~ 
Phen 0 = o, + - [4h°Q” — 1] where ho, = >> (y; — g)*, and the variance of 


i 
N-no 
N-1n- 

Let us assume now that the size of stratum is mh where m is a factor of 2Q, 
say 2Q0/m = L,,. Then the variance within each of the L,, strata is a constant, 


> 


the mean of an unrestricted random sample of size n is ¢3, = 


say, o; where o; = o, + 12 |h-m — 1jifmiseven. If m is odd then L,, is even 


h 


DD (yi ms 


hm 


h 1 al aoa : : 
y) (: ~ : while in the other strata, the within stratum variance is 


— 


, lx . htt 
é-Low-ali- ma ). 


hm = 


and in half the strata the within stratum variance is o; + 


12 
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Then, if c elements are sampled at random from each of the L,, strata, it follows 


that 
2 L mh - *) oi 
n L,. \mh — 1) 


1 (mh —c\1f 2 | nr 
= ——— —|o, - thm — 1}}. 
lows (3 ~ ‘) c (<i - ia! !) 

In order to evaluate the variance of the systematic sampling mean let us 
evaluate Z (x; — jin) = k(n — 8)s%53. Now upon substituting for x, , it 
follows that k(n — 8)s:3 = D> (y; — Yan)” — 2BkO ZL (y; — Yin) + 

J 2 
k(n — BRS. 
Then, if k is a multiple of h, it follows that >> (y; — yjass) = 0. Furthermore, 
, 
if k is an even multiple of h, then y; = yj.s, and hence >> (y; — yj+a)” = 0. 
Finally, if & is an odd multiple of h then, if 6 is an odd number y; — yj45. = 
2(y; — 9%) while, if 6 is even y; — yj40 = O and hence 


Dd (yi — yisn) = 420 — 9” 
2 7 


= 49S we 


if k is an odd multiple of h and 6 is an odd number. Note that if k is an odd 
multiple of h, then n is an even number. Since 


a =o — +, (n — dai 
it is necessary to evaluate A (n — 5)si3. Now, if k is an even multiple of h, 
it follows that (n — 6)s.5 a to — 6)B’k’s and 
Le (n — 6)sis = BPkein DF — 2X 5°} 


n(n? — 1) 


—_— 2 7, 
= Bk 12 


Hence, if k is an even multiple of h, it follows that on 


On the other hand, if k& is an odd multiple of h, and if 6 is odd, 
we have (n — 8)si3 = (n — 5) BRS + 4(n — d)o;, while if 6 is even (n — 5) 8k = 
(n — 6)Bk’s’. 


Hence 


i B? 22 2 cs be, 
ie (rn — 6)S5 = wn ' 1) + no,. 
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Hence, if k is an odd multiple of h, it follows that 


_ 2 Bk(n'-1)_ >» 
el lu 


Then, if k is an even multiple of h 
RB’ — B’ 


. + 
= + 55 


os =o, + k(n? — 1) 


(k oe 1), 
9 B 2 2 
and, if k is an odd multiple of h, then oz = 12 B’ (k — 1). 
Thus, systematic sampling will yield superior results if 


C= 


meee 
120, 


B(hm)(hm—1) 


Ty 


Since ’ > cit follows that for a solution, c, to exist, we must have 


N > 2p? — pL — 122 ( L' ). 


7) 


BB \N-—L 

12. Summary. In this paper we have presented the theoretical basis for 
systematic sampling for stratified and unstratified populations including the 
derivation of the variances, a study of the possible values of the parameters, 
estimates of the parameters, the effects of changing the size of sample, and 
comparisons among systematic sampling, unrestricted random sampling, and 
stratified random sampling. The paper contains for the case where the sampling 
unit consists of one element, not only the theory necessary, but in addition, 
some analysis of the conditions under which systematic sampling ought be used, 
and formulas for calculating the variances. 

In later papers of this series, we shall present the theory of systematic sampling 
when the sampling unit is a cluster of elements, the theory when we assume we 
are sampling not from a finite population but an infinite population, each of whose 
elements is normally distributed, and further studies of various parts of the 
theory and practice of systematic sampling. 


APPENDIX A 


Values Assumed by Certain Variables 


In order to avoid repeating the limits of summation of variables, we shall give 
these limits in this appendix. 
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TABLE I 


Values Assumed by Subscripts 


Letter The letter will assume all integral values from 1 to 

k 

n— 6 

k(n — 6) 

n—1 
kn 
nr 
nv 

n/2if nis even, "— if nis odd 


2 
a, b L 
The letter 8 will assume the values 7; , 72, --+ , ig Where 2, --- , 7, are a selection 
of g of the k integers 1, --- , k. 


APPENDIX B 
On the Limits of Some Finite Sums 


The difficulties that arise in the transformation of finite sums are very similar 
to those that arise in the theory of transforming multiple integrals, i.c., the effects 
of transforming variables or order of summation on the limits of summation. 
Certain lemmas that have proved useful in this paper are presented separately 
here in a more general form. 

Let f(u) and f(u, v) be functions of u and v that are finite for all possible values 
of u and v. 

LemMa 1. 


7 S (Vistek » Litcy—ve) = 2 S(®ita—ne » Li¢—rgs—ve) 

- m 

Proor: Let a = X and lety = A+ 6. Since 1 < a < yandy < n, the possible 
values of 6 are 1, --- , (m — 1). For any fixed value of 6 the possible values of 
\ then are 1 ton — 6 since \ = y — 6 and, for a fixed value of 6 the maximum 
value of \ is determined when y = n. With these limits each term of f on the 
left side of the equation occurs once and only once on the right side of the equa- 


tion. Furthermore, no additional term occurs on the right side of the equation. 
LemMa 2. 


i LS. HA-Dk 4 Lis a48—1k) _ D(a; ’ Lj4Ks)- 
a d 


Proor: Let 7 = 7 + (A — 1)k. Then j is a monotone increasing function of 7 
and}. The minimum value of j occurs when i = 1. In that casej7 = 1. The 
maximum value of j occurs when 2 = k, A’ = n — 6. In that case 7 = (n — 4)k. 
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With these limits each term of f on the left side of the equation occurs once and 
only once on the right side of the equation. Furthermore, no additional term 
occurs on the right side of the equation. 

LEMMA 3. 


Z I (Xista—ve ; Liscy—vk) — > f(a ’ Li+8k)- 
4,7 


ta.7 
acy 


Proor: First apply Lemma l to > f(s ca—e 5 Cis(7—1e) and then apply Lemma 
as 
a<y 


2 to the resulting expression. 
LemMMA 4. 


D [f(a + Saisis)] = (x — 1) D fla. 


5,] 
Proor: Let m = 7 + ké. Then for any fixed value of 6 the minimum value 
of m occurs when j = Ll. In that case m = ki + 1. For any fixed value of 4, 
the maximum value of m occurs when 7 = k(n — 6). In that case m = nk. 


The letter m will assume all integral values from ké + 1 to kn, and hence, 


2 f(x) + 2 f(tises) = 2 f(x) + > f(am). 


If we sum 6 from n — 1 to 1 instead of from 1 ton — Lin >> f(xm) we see that 


5.m 
k(n—1) kn 


2 f(x) + Des (tm) = 2 fe+ dX Sn) 


5,m m=k(n—-1)+ 


! 


+ ee 


+ > s(a,) + - J (Xm) 


j=1 m=k+1 


where the summations of x; are terms of Zz f(x;) and the summations of z,, are 
6,j 
k(n—6) kn 


terms of >> f(am). But >> f(x) + > ~—= ff (&@m) 
j=l 


6,m m=k(n—6)+1 


> f(x,) and hence 


Lemma 4 is proved. 
LemMMA 5. Let 


Zz f(x pak) S (tiscy—k) = A. 
Then 
A= nD [s@)? — DL U@) — fis)? 


PROOF: 


t,@ 


A = 2 [f(rirca—ye) + 2 >» f (Xi+ce-1x) f(z; (yk) 
a<y 
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SYSTEMATIC SAMPLING 
By Lemma 3 


1,a, 
a< 


2 - f(x ‘ (a—1k) f (ai + (y—1)k) — 2 2» F(x) f(a, + bk) 


ad 


and since we have 


2f(x faire) = S(xj” + S(ejrn)” — Ue) — Seis, 


the proof is completed by using Lemma 4. 


Lemma 6. Let knf = > f(a). Then 


| — | 3 ; I 4 \ 2 
A(z) re J = (1) a | f(a,) o f) Pa (4) 2, [f(2;) _ S (aj+08)) : 


ProoF: This lemma is a direct consequence of Lemma 5. 
LeMMA 7. 


A = Qe [fle) — FP + 220 flea) — Filfwisas) — fl + kn'f’. 
Proor: From Lemma 4, it follows that 


A=n f(a)’ — Dd) (fe) —FP + esses) — FP + 22 [f(x 3) — Af(@wisis) — fi 


j,6 


and hence, from Lemma 3, it follows that 
A=nQdif@) — FP + Wkf — aw - DX S@,) - FP 
+ 2 Ps) — fS@ise) — FI, 


whence the lemma is proved. 
Lemma 8. 


I 2 | | 212 2 oo it 
(25) -j= (23) XL [ f(a) -—iT + (3) 2, (fa) IVS (rises) — fi. 


This lemma is a direct consequence of Lemma 7. 
Lemma 9. IJIfh > kn, let x, equal x;_,,. Let f(u,v) = f(v, u) i.e. f is symmetric. 
Then, af we let 


dis = Dif(es, sss) 
7 
it follows that 


dis + dings = DS, ’ Lv4ka)- 


v 


ProoFr: Obviously 


> f(a, > Xs) = dis + B, 
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where 
kn 


B= 7 f(Xq , To+K8). 


g=k(n—5)+1 


Now, let h = g — (n — 6)k: Then 


5k 
bL =< i f(x, #(n—B)k y Th +kn)- 
h 


n=1 


Since Xnsin = Xn, and f(Ap4(n—sye 5 Te) = S(Th 5 Las-cn—sx), it follows that B = din, 
and the lemma is proved. It is noted that the symmetry of f(u, v) is necessary 
as well as sufficient, for if f(a, , 2445) = %, — Xy+05 the theorem is false. 


APPENDIX C 


Stratified Sampling 


Let the population P consist of L strata P;,---,P.,. Let & be the arithmetic 
mean of P, and Z, the arithmetic mean of P,. Let %, be the sample estimate of 
%,, and let ? = Dock. Then &&% = >> cA, = A where S&%, = A,. Let 

a a 


” 


2 . 2 ~ fa a \2 r 2 ~/~ 2 } = 
o; be defined by o; = G&(% — ¥). Then a; = G(F — A) + (A — &) and hence 
it is easy to see that o; = >> cacsoz,z, + (A — 2)” where 


a,b 


c 


Or4%, = SF, al AG, 77 As) 


(A — &) = |= (co. — = ia) | 


and if NC, = N,, then 
(A — ¥) 


° 


= =. Cu(Aa = Fa) (Ay = Za) 


a,b 


and o; = >> Calt Oz, 7, 


a,b 
where 
62,3, = &(Fa = Fa) (Zs = Xp). 


These formulae hold whatever may be the method used in sampling the 7th 
stratum. If % is an unbiased estimate of % and Z, is independent of %, , then the 
usual formula o; = >> cio;, holds. The formula for oz,z, will, of course, depend 

a 


on whether a random, cluster, systematic, or other sampling procedure is used. 
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ON THE PROBABILITY THEORY OF LINKAGE IN MENDELIAN 
HEREDITY 


By Hitpa GEIRINGER 
Bryn Mawr College 
1. Introduction. If for a certain generation the distribution of genotypes is 


known and a certain law of heredity is assumed, the distribution of genotypes in 
the next generation can be computed. Suppose there are N different genotypes 
N 


‘ ° ° ° ( 
in the nth generation in the proportions x{", --- , x\” where >> 2$” = 1 and 
t=1 


denote by pi, the probability that an offspring of two parents of types x and 
N 

be of type i where >, pi, = 1 for all x and A, and pi, = p,. Assuming pan- 
i=1 

mixia, identical distributions x;"” for males and females, etc., we can derive 

a\"*» from as” by means of the formula 


z 


(1) i) = DE paar” ay” (j= 1,2, --- N). 


N 
«,A=1 


Thus if the distribution 2!" is given for an initial generation we can deduce suc- 
cessively the x{”, x{”, --- for subsequent generations. Besides, one may wish 
to express the a\", for any n, explicitly in terms of the initial distribution 2{", 
ie. to ‘solve’ the system (1). <A further problem consists in determining the 
limit-distribution of the genotypes lim x{" (i = 1, --- , N). 

Mendel’s heredity theory is based on some ingenious assumptions which are 
known as Mendel’s first and second law. They enable us to define the possible 
genotypes and to establish the recurrence formula (1); they will be explained and 
formulated in sections 2and 3. It is well known that in Mendel’s theory it makes 
an essential difference whether one or more ‘‘Mendelian characters’ are con- 
sidered. In the first case Mendel’s first law only is used; there are with respect 
to this character but N = 3 different types and the recurrence formula (1) can 
be derived without difficulty. As early as 1908 G. H. Hardy [5] established the 
simple but most remarkable result that under random breeding a state of equilib- 
rium is reached in the first filial generation, i.e. «{” ¥ x{° (in general) but 2{” = 
x}. (n = 2, 3, ee - 

In the case of m = 2 Mendelian characters Mende] assumed independent 
assortment of these characters (Mendel’s second law). However, within four 
years after the dramatic rediscovery of Mendel’s fundamental paper [10], observa- 
tions were reported that did not show the results expected for two independent 
characters. T. H. Morgan [11] and collaborators in basic contributions, con- 

1 See also [12] where the stability of the particular ratio 1:2:1 is recognized. 
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cluded that a certain linkage of genes was to be assumed.” Taking that as the 
starting point, the main purpose of this paper is to establish the basic recur- 
rence formula for the general case of linkage, to solve the corresponding system 
of difference equations, and to determine the limit distribution of genotypes, 
Throughout the paper ‘multiple alleles” are considered instead of making the 
frequent restriction to two alleles. This generalization is, however, an obvious 
one (see section 1). 

In order to deal with the general problem a linkage distribution (1.d.), is in- 
troduced. This concept, which seems to be basic to the whole problem, refers 
to the probability theory of arbitrarily linked events [3]. The crossover prob- 
abilities, (c.p.), defined by Morgan and Haldane are, notwithstanding their high 
importance, not sufficient for our purpose. (They turn out to be certain mar- 
ginal distributions of the I.d.) If, however, m = 2 and NV = 10 (for two alleles), 
a case studied by W. Weinberg [16] H.S. Jennings [7] and R. B. Robbins [14], 
the ¢.p. is equivalent to the l.d. But for the general case the |.d. is needed and 
the desired results must be derived by other methods than explicit computation, 
which is feasible if m equals one or two. The original problem of independent 
assortment appears, of course, as a particular case of the general linkage. This 
problem was completely solved in 1923 by H. Tietze [15] in a very interesting 
but rather involved paper. The proof of the limit theorem given in the follow- 
ing pages for the general case is far simpler and shorter than the treatment of the 
particular case in the older paper and is therefore a simpler proof of Tietze’s 
theorem. 

After a brief consideration of the classical case m = 1 (section 2), the problem 
of m arbitrarily linked characters is discussed in section 3 with a particular view 
to a clear statement of the biological and mathematical assumptions. The l.d., 
its.relation to the ¢.p.. and some basic properties of both are considered in sec- 
tion 4. Then, after a very concise consideration of the case m = 2 (section 5), 
the basic recurrence formula is established in section 6 from which we deduce in 
section 7 two general limit theorems. The main point is that the limit dis- 
tribution of genotypes is “uncorrelated”? and equals the product of certain 
marginal distributions of first order deduced from the distribution for the first 
filial generation. As a kind of an appendix section 8 contains the solution of 
the system of equations furnished by the general recurrence formula. 

In the second part of the paper an attempt is made to contribute to the linear 
theory or theory of the linear order of the genes, from the point of view of prob- 
ability. theory. Accordingly, the linear theory consists in certain assumptions 
on the.l.d., or on an equivalent distribution which will be called crossover dis- 
tribution,--(c.d.), and which is more appropriate for this purpose. (Sections 9 


fo T. H. Morgan and his associates and students is due the credit for opening up this 
new field of genetic research; and the smali vinegar fly Drosophyla Melanogaster upon which 
most of their work has been based, has now assumed as great an importance in genetics as 
the famous peas studied by Mendel.’’ (Sinnot and Dunn, Principles of Genetics, New York 
1939.) 
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and 10.) In this connection in section 10 a probability definition of the ‘‘dis- 
tance” d;; of two genes is proposed which, far from being contradictory to Mor- 
gan’s ideas on the subject seems to formulate them mathematically; (the dis- 
tance d;; between two genes 7 and j is defined as the mathematical expectation 
of the number of crossovers between i andj). This distance is of course additive 
as it ought to be in the framework of: the linear theory. 

A problem frequently discussed is whether the crossover probabilities are 
independent of each other (this independence is not identical with Mendel’s 
free assortment). Observations (see [4a]) did not seem to substantiate this as 
a general assumption. Then it was concluded that there exists a so-called 
interference which prevents, i.e. diminishes the probability of crossovers too 
“near” to each other. (See also [13].) It seems to the author that observations 
on interference should be interpreted in terms of appropriate assumptions re- 
garding the I.d. or the e.d. Again the remark holds that the ¢.p.’s are not suffi- 
cient for describing the situation. Hence in section 11 an attempt is made to 
understand “interference”? by means of the ¢.d., accepting however the linear 
theory. It is well known that the explicit presentation of consistent dependent 
distributions is not trivial (see e.g. [2]). Not many different types of ‘‘conta- 
gious” distributions are known. In section 11 two such schemes are proposed 
which, though simple enough, seem to correspond to the general idea of inter- 
ference. They contain as particular cases the case of independent and the case 
of disjoint crossovers. 


2. One Mendelian character. Hardy’s theorem. It will be helpful to start 
with the simple and well known case of one character introducing the basic con- 
cepts in a way appropriate for generalization. 

Mendel recognized that the distribution of certain hereditary attributes in 
organisms is similar to the distribution of attributes in a probability distribution. 
With respect to a .Wendelian character each individual is characterized by two 
elements called genes which represent two possible alternatives. The color of 
the flower of peas is such a character, the alternatives being red and white. 
With respect to this character each plant belongs to one of the three types: 
red-red, red-white, white-white.® These are three different genotypes.—In this 
paper genotypes only will be considered. The difference between genotypes and 
phenotypes and the related concepts of dominant and recessive qualities will 
not be dealt with. This is an example of a two-valued Mendelian character, i.e. 
a character for which only two possibilities exist or, using a more technical term, 


It will be assumed throughout that the individuals considered are ‘‘diploid’’. That 
means in the terminology of the preceding example that the only possible types are RR, 
RW, and WW;; or, using A and a: AA, Aa, and aa. Modern research has however revealed 
that situations may arise where ‘‘tetraploids’’, ‘‘hexaploids’’, ete. briefly ‘‘polyploids’’ 
prevail, i.e. types like A7a” (with r+ y = 2p). In this case the reproduction cell segregates 
A*q” (with 2; + y: = p). Stability is no longer reached in the first filial generation. See 
[4b]. 
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with two alleles. The case of two alleles is most frequently considered in the 
biological literature where the two possibilities correspond mostly to a dominant 
and a recessive quality. There is, however, no difficulty in considering from the 
very beginning the general case of multiple alleles where the character under 
consideration is assumed to be r-valued, i.e. susceptible to r different manifesta- 
tions (e.g. r = 5 possible colors of a plant). These r possible values may be 
distinguished by the r arguments, 1, 2, --- r. 

In the consideration of only one Mendelian character Mendel’s first law only 
is used which may be stated as follows: 

(a). With respect to one r-valued Mendelian character each individual 
belongs to one of the r(r + 1)/2 possible types, each type being determined 
by a pair of elements (genes) x and y E Parr ") ‘ 

“Ny = leer 

(b). In the formation of a new individual each parent transmits one of its 
two genes to the new individual, the other gene coming from the other parent. 

(c). The probability for the transmission of either gene is the same and 
thus equals 3. 

We wish to deduce the distribution of genotypes in the (n + 1)st generation 
from the distribution of genotypes in the nth generation under the assumption of 
complete panmizxia (random breeding). Moreover, assume that the given initial 
distributions of genotypes as well as the laws of heredity are the same for males 
and females.’ In computing successively the new distribution from the pre- 
ceding one we shall always assume that the distribution of individuals partici- 
pating in the process of procreation is the same as their distribution when born. 

Let us denote a genotype by (x; y), (@ = 1,---,r;y = 1,---,7r). To fix 
the ideas we shall assume through this paper that the gene x before the semi- 
colon was transmitted by the mother, and the y after the semicolon by the father 
of the individual. In some cases which will be considered later this distinction 
will be relevant. Denote by w‘” (x; y) the probability of the type (x; y) in the 
nth generation. Since the laws of heredity are the same for males and females 
we have w'” (x; y) = w™ (y; x) and thus have for each generation a symmetric 
distribution of genotypes with r” probabilities whose sum is one. There is, 
however, according to principle (a) no difference between the types (x; y) and 
(y; x) and therefore it is preferable to group together these types, thus intro- 
ducing forz = 1,---,r;y=1,°:-,r: 


) v(x; 2) = w(x; 2) 
(2 
v(x; y) = w(x; y) + w” (y; x) where x < y. 


‘Tt is simplest to deal with mere pairs of alternative conditions (alleles) but a theory 
remains seriously inadequate unless capable of extension to multiple alleles.”’ ({17] p. 224). 

5 It is obvious that we may admit without any change of result different distributions for 
males and females in the initial generation, as long as random mating takes place after- 
wards. 
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Consequently there are r(r + 1)/2 such probabilities: 
(n) - (n) 7. AGL oe hl (nm) 5 (mn) om CO ve 33 
(2’) v (1; 1), (1; 2), ---2 (1; 7r),v (2; 2), --- (2;r),--:0 (r; 1) 
where 


(3) D> vo (2; y) = 1 (n = 0, 1, 2, ---). 


Now define p‘"’(x) as the probability that in the nth generation a male (or a 


female) individual transmits the gene x. Obviously we have: 


™e) = do (1s zr) + Bo (2; 2) +e + o'™ (a; 2) 
4 
(4) + ho (as0+ 1) +--- + bd (z;1r) 
and 
(4’) p(x) = 1 


z=1 


In fact, the gene x will be transmitted, if an individual possesses this gene and 
also transmits it. The individuals of type (y; xz) (or (x; y)) all possess the gene 
z and transmit it with probability 3 if y + x and with probability 1 if y = 2. 
Besides, the probability of the type (x; y) in the (n + 1)st generation is ob- 
viously p‘"’(x)p‘”’ (y): 


,(n+1) 


(5) w' (2; y) = p™ (x)p (y) = wy; 2) 


or in terms of the v‘”(z; y) 
y' "TD (x. xr) es [p’” (x)} 
v(x; y) = 2p (x)p" (y) (x < y). 


- (n+l . (n) 

Hence by (4) and (5’), v"~ has been expressed in terms of v'" and the recur- 
a na . . ° (n+1) —- 

rence-problem is solved. The distribution w'"~’(x; y)(n 2 0) shows ‘‘inde- 


pendence,”’ and is therefore known to be stable. In fact, computing in the same 


n+1) \ 
way p"” (x) we get 


p"*» (x) iit 1.2n” (1)p™ (2x) + aoe p” (x)p"” (x) 
+ 2.29 (x)p (x +1) +--+ + 4-29 (x)p™ (r) 


pa) vO) = PO) 


I 


or 
p'"* (2) ws p’” (x) 
(n _ 0, i, 2, ici ), (x —_ iL, 2, io r). 


This last formula contains G. H. Hardy’s famous result [5] that p‘” (x) is the same 
for all n: 


(7) p” (x) = p (2) (n = 1, 2, ay ») 


(6) 
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and because of (5’): 


(7') v@a;y) =eP@;y) ws yn =2,3,--), 


In case of only one Mendelian property the distribution of genotypes reaches a 
stationary state in the first filial generation. 


3. Basic assumptions in case of m Mendelian characters. A new situation 
presents itself if there is more than one character. In case of m characters a 
genotype is described by 2m numbers (a1 , +++ , mi Yi, °** » Ym) or briefly (x; y) 
(e.g. for m = 5, r = 9:(1,2,3,4,6;2,7,3,5,9). There are primarily N = r” 
possible types because on each of the 2m places any of the r numbers can be 
written. Now, if the types (x; y) and (y; x) are considered as identical genotypes, 


> ° ¥ / m 7 . 
the number of different genotypes reduces to N; = - (r" + 1) (e.g. for r = 2, 


m= 1:N, = 3;forr = m = 2: N, = 10). It is essential for the understanding 
of linkage that in counting this way two types like (1,3; 5.7) and (1.7; 5,3) or 
(1,1;2,2) and (.,2;2.1) are considered as different although in both cases the 
individual possesses with respect to the first character the gene pair 1,5 and with 
respect to the second the pair 3,7. If no difference is assumed between two such 
il s rir + 1)\" , 
types the number of different genotypes reduces to Vo = ( —— ) . (E.g. for 
r= 2:N = 4", N, = $-2"(2" + 1), Ne = 3"; hence for m = r = 2:N = 16, 
N,; = 10, Ne = 9 or for r = 2, m = 3:N = 6, Ni = 36, Ne = 27). Which 
method of counting is the correct one? 

The answer is that there are but V2 different genotypes if Wendel’s second law, 
the law of independent assortment, is accepted. Then and only then there is no 
difference between types like (1,3:5,7) and (1,7:5,3). Under the assumption 
of general linkage however, these types must be distinguished, not as individuals, 
but with respect to their heredity properties, i.e. considered as parents of a new 
generation. Under this assumption there are in general N, different types. 
This will be discussed presently in more detail. 

Let us first consider Mendel’s original theory as contained in his first and 
second law. Analogous to (a), (b) and (ec) in §2 we now formulate as follows: 

(a’) With respect to m characters the genotype of an individual is char- 
acterized by m pairs of numbers. Two individuals are of the same type if to 
each of the m characters corresponds the same pair. Hence there are Ne = 

r(r + 1)\" 

(e2") genotypes. 

(b’) In the formation of a new individual a parent of type (21, --+ , Ym} 

Yi, °** , Ym) txansmits to the offspring, corresponding to each of the m char- 

acters, one of the two genes which he (or she) possesses with respect to this 

character. 

(c’) The probability of transmitting any of these 2” combinations is the 

same and therefore equal to 1/2”. 
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Consider e.g. the individual (1,2,3:1,4,7); the pair 1,1 corresponds to the 
first character the pair 2,4 to the second and 3,7 to the third. Under the 
assumptions of Mendel’s original theory this individual is of the same type with 
(1,4,3; 1.2.7) and (1,2,7; 1,4,3), and of course with (1,4,7; 1,2,3), ete. 
As m = 3, it may transmit eight combinations which in the preceding example 
reduce to four, because the individual is homozygous in the first character. 
These four combinations are 1,2,3 or 1,4,3 or 1,2,7 or 1,4,7 each with prob- 
ability 2 X § = f. 

The distribution of genotypes in successive generations under the assumption 
of Mendel’s second law has been investigated by H. Tietze [15] who also con- 
siders the limiting distribution asn — x. His results will appear as a particular 
case of our general considerations. 

In order to discuss the basic facts which lead to the idea of linkage let us for 
the moment consider the case m = 2. Soon after the rediscovery of Mendel’s 
work Bateson and Punett reported observations which did not give the expected 
numerical results. To understand the type of such an observation assume that 
a homozygous male of type (1,1; 1,1), [or any other homozygous type, e.g. 
(2,3; 2,3)] is mated to a homozygous female of type (2,2; 2,2) [or to any homo- 
zygous type different from the first e.g. (4,5; 4,5)]. Obviously, in this case there 
is only one possible kind of offspring namely (2,2; 1,1), [or (4,5; 2,3)]. But 
if now one of these daughters is mated to a homozygous male of the original 
type (1,1; 1,1), there are four kinds of possible offspring, namely (2,2; 1,1), 
(2,1; 1,1), (1,2; 1,1), and (1,1; 1,1), corresponding to the four combinations 
of genes transmitted by the heterozygous (dihybrid) daughter for (4,5; 2,3), 
(4,3; 2,3), (2,5; 2,3), and ‘2,3; 2,3)]; and according to the idea of free assort- 
ment each of these four combinations should appear with the same relative 
frequency: }. But it was observed that the combined frequency of the two 
types (1,1; 1,1) and (2,2; 1,1) was larger than that of the types (2,1; 1,1) 
and (1,2; 1,1). ‘‘The characters that went in together have come out together 
in a much higher percentage than expected from Mendel’s second law, viz. the 
law of independent assortment”’ [11]. Morgan, in his theory of the gene called 
this ‘‘tendency”’ linkage. The idea is that the two genes 2,2 and 1,1 which 
have been together in the maternal individual tend to stay together and that 
nature has to make an effort to produce a so-called crossing-over, i.e. a separation 
of the genes ‘‘that came in together,’—such that a female of type (2,2; 1,1) 
may transmit the group 1,2 or the group 2,1. In other words, the idea of linkage 
implies an influence of the grandparents. 

According to observation the percentage of crossing over varies from 0 to 50 
per cent, i.e. from complete linkage to free assortment. It will appear however 
that in principle crossover-values greater than 50 per cent cannot be excluded. 
It was also observed that the percentage of individuals of type (1,1; 1,1) equals 
very nearly that of individuals of type (2,2; 1,1), as we would expect. In the 
same way the percentages of types (2,1; 1,1) and (1,2; 1,1) are nearly equal, 
their sum vielding the crossover-ratio. Hence the four probabilities correspond- 
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ing to the formation of the four types (1,1; 1,1), (2,2; 1,1), (2,1; 1,1), and 
(1,2; 1,1) are assumed to be (1 — c¢)/2, (1 — c)/2,c/2,andc/2. It is important 
to notice that these are at the same time the probabilities that the female of 
type (2,2; 1,1) (which was mated to the homozygous (1,1; 1,1), transmits the 
groups 1,1 or 2,2 or 2,1 or 1,2 respectively. 
m m(m — 1) 

In the general case of m characters there are ( . = - a Crossover 
probabilities. In this case Morgan assumes linkage-groups, each group consist- 
ing of m; elements with Le m; = m, such that ‘‘there is linkage between the 


1 


elements of each group but that the members belonging to different linkage 
groups assort independently, in accordance with Mendel’s second law.” This 
idea will be reconsidered in Section 4. 

If we now wish to solve our first basic problem, i.e. to derive the distribution 
of genotypes in any later generation from an initial distribution of genotypes, 
then the concept of crossover probabilities does not suffice. The complex 
possibilities which arise if Mendel’s second law is no longer accepted as universally 
valid cannot be adequately described in terms of crossover probabilities. Or, 
more exactly: It will be seen that if m 2 4 the crossover probabilities are no 
longer sufficient, whereas for m = 2 and m = 3 this concept is general enough. 
For the complete description of the hereditary mechanism in the general case a 
so-called linkage distribution, 1.d., is needed which involves 2” probabilities with 
sum equal to one. Let us define this distribution. 

Consider an individual of type (a1, +--+ 4 %m3 Yi, °°" > Ym) = (x; y), where the 
x are the maternal genes, the genes contributed by the mother of the individual, 
and the y the paternal genes. Denote by S the set of the m numbers 1,2, ---, 
m, by A any subset of S, and by A’ the complementary subset A’ = S — A. 
Denote by I(A) the probability that the individual (a; y) transmits the paternal genes 


belonging to A and the internal genes belonging to A’. There are 1 + m+ (3) 


+ --- + 1 = 2” such subsets A and accordingly 2” probabilities /(A) where 
(8) > UA) = 1. 


(A) 
In accordance with the previously reported observations and with our assump- 
tion of equal conditions for both sexes one must assume that 


(8’) (UA) = UA). 


The conditions (8) and (8’) reduce the number of freely disposable values of the 
l-distribution to (2""' — 1). The l-distribution is a socalled m-dimensional or 
m-variate alternative which could also and occasionally will be denoted by 
l(e, , €2, °°* » €m) Where e; = Oorl. Thus e.g. l(1,1,1,0,0,1) is the probability 
that the genes yi , Yo, Ys, 14, Xs, Ys, are the genes contained in the germ cell of 
the individual (xz; y). Here the set A consists of the numbers 1 ,2,3,6, and A’ 
of 4,5. 
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Analogous to the statements (a), (b), (c) of §2 and (a’), (b’), (c’) of the present 
section we may now formulate the principles of Mendel’s theory of heredity under 
the assumption of a possible linkage of the genes: 

(a’’) With respect to m Mendelian characters an individual is characterized 

by two sets of numbers each consisting of m numbers, viz. 24, --- ,%mand y., 

-** , Ym, Where . = 1,2,---,r. If the type of an individual is designated 


by (a1, °** 5 %m3 Yr, °°* » Ym) = (@; y) where x and y denote the maternal and 
paternal contributions respectively, then (x; y) = (y; x). Hence there are 
N, = 3r"(r" + 1) types of individuals. 

(b’’) = (b’) In the formation of a new individual each parent transmits to 
the offspring one set of m genes. 

(c’’) For each parent, the 2” probabilities of transmitting any one of these 
2” possible sets are given by a linkage distribution /(A) where A is a subset 
of the set S consisting of the m numbers 1, 2, --- , m, and 1(A) is the prob- 
ability that the transmitted set consists of the paternal genes belonging to A 
and of the maternal genes belonging to A’ = S — A, and l(A) = IA’). 


4. Some properties of the linkage distribution and of the crossover probabili- 
ties. In the following we shall need marginal distributions, that is partial sums, 
of the probabilities within a distribution. In a usual notation: 


h(i) = >> do --- Do Ua, ae, «> m distributions 
z2 z3 Zm 


lio(a1, 2) = Zz see > l(a, 2, °°°, & (7) distributions 
73 


zm 


(9) 
Iy03..-m—1(1, Voy °°* y Lm) = 7. U(ai, %2, °°" .......m distributions 

\ 
Ine...m(%1 Ley °°% 5 Bm) = Uti, He, *** » Bm) the original distribution. 


These are general formulae for any discontinuous distribution. But if the dis- 
tribution happens to be an alternative, as the l.d., where x; takes only two values, 
any marginal distribution can be completely characterized by two subsets A 
and A; of S where A D Ai. Denote by l4(A1) the sum of all possible linkage 
probabilities which contain all points of A, and no point of A— A,. If,e.g.m =8 
and A consists of 1,3,5,6 and A, of 1,3,6 then 14(41) = lias (1,1,0,1) = 

> (1, 22,1, 24, 1,0, 27,28). According to the previous notation we have 


THF 4rF7TQ 


as usual 


(10) 1s(A,) — 1(A), or lie ae m(X1 oe ae Sun) a Lay oe La) 
and 


lo(O) = 1, if A = O is empty. 
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We will use for the linkage distribution and their marginal distributions the 
customary notations or these new notations, whichever is more convenient.” 

As an immediate consequence of our definitions we get the following properties 
of the l.d. 

(i) If (8) holds for any A than 


(11) l4(Ay) = la(A — Aj). 
(ii) As a consequence of (8) it follows (with the notation (9)) that 
(9’) 11) = 1,0) = 3. 


(iii) If c;; denotes the c.p. between 7 and j, then 


(12) Cs > ty > 1; (1,0) + 1; (0,1) = 21; (1,0) = 21; ;(0,1). 


(iv) For any three subscripts i, 7, k the “‘triangular’’ relation holds 


(13) Cip + Cue = Ck 


and 
(14) Cij + Cre + Cx S 2. 


To prove this consider the marginal distribution J; ;.(2,2;2,). From (11) and 
(12) we conclude 


= Q[l; (100) + 1; ;2(010)] 
= Ql; ;.(100) + 1; ;.(001)] 
= 2[l; (010) + 1; ;.(001)] 
= 21; ;,(000) + 1; ;e(100) + 1:j.(010) + 1;5.(001)]. 


6 It is easy to indicate experiments which should furnish the relative frequencies corre- 
sponding to the l.d.: If a homozygous female (x, +--+, 2n; 21, ---, 2m) is mated to a homo- 
zygous male (y:, °**, Ym3 Yi, ***, Ym) Where each x; ¥ y; , the resulting offsprings will all 
be of type (%1, +++, m3 Yi, °**, Ym). If such an offspring is back crossed to (y:, +++, Ym} 
Yi, *** ,» Ym) there will be 2” different genotypes of offsprings, viz. (2, , %,---, ; Mi 
Yo, °°*, Ym), (Yr, To, °°+, m3 Yr, Y2,+°*, Ym), ete. whose frequencies are proportional 
to the 2” values of the l.d., viz. to l(0, 0, --- , 0), 11, 0, 0, --- , 0) ete. Such an experiment 
should give the same results for any two sets of z’s and y’s. (There is, of course, the statis- 
tical problem how to determine the ‘‘best’’ values of the l.p. from these observations. ) 
In an analogous way a marginal distribution can be observed: Suppose we wish for m = 5, 
the lis3 (€: , €2 , €3).. The offspring of a cross between females (2 , 22, 3, 41, %53 Xi, X2, 23, 
4, 5) and males (y:, y2, Ys, Ts, Ls} Yr, Yr, Ys, Ta, Ls) are of type (m1, V2, X3, Xs, Vs; 
Yi, Y2, Ys, X41, %). If they are crossed to (4%, °°: , %3 3%, +++, Xs) there will be eight 
different types of offsprings proportional to the eight values of li23; (e: , €2 , 63). In this last 
setup the y; should be dominant and in the experiment, described above, the y; should be 
recessive in order to be able to distinguish between the phenotypes of the individuals. 
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Solving these equations with respect to the /-values we get 
Li 3.(100) = ¢ (cis + Cu — Cyr) 

(15) Ui jx(010) = % (cis + Ce — Cx) 
Lijx(001) = 4% (Cie + Cie — C:5) 

(16) 1; (000) = 4 (2 — ci; — cu — Cjx). 


Thence (13) and (14) follow. The condition (14) is of course always fulfilled 
if c:; S 3, but this restriction does not seem to be necessary. From (15) and 
(16) we deduce: 

(v) If m = 3, the set of three e.p. ci, C13, C23 for which the inequalities (13), 
(14) hold is equivalent to the l.d. l(a, , x2 , x3) for which (8) holds. For m = 4 the 
c.p. are no longer equivalent to the ld. Another necessary condition for the 
e.p. will be derived in section 8. 

Now let us consider and characterize some important particular cases of the l.d. 

(i) Free assortment (Mendel). In this case all 2” values of the l.d are equal 
and therefore equal to (3)”. 

(11) Complete linkage (reported by Morgan and other authors). In terms 
of the l.d. this means 


(17) (1,1, --+, 1,1) = 10,0, --- ,0,0) = 3 orle(S) = }. 


Consequently, all other values of the l.d. are zero. It follows that all c.p. are 
zero because all 1;; (1,0) are zero. (See also Theorem I, section 7.) 

(ii) Linkage groups (Morgan). In terms of the |.d. this means that the l.d. 
resolves into a product of several distributions, e.g. 
(18) U(x, Ho, °° , Xy) = f(a, Xe)g(as , Xs, Xs)h(re , X7, Le, To). 


(There is no loss of generality in assuming that numerically consecutive charac- 
ters form a linkage group.) As f, g, and h are distributions it follows with nota- 
tion (9) that ‘‘within”’ the groups: 


Ce = 2f(10), ess = 2G3s(10),---, cas = 2Gu5(10), 

Cer = Zhez(10), --- , Ceg = Zhgo(10) 
these crossover values are auite arbitrary. On the other hand we have because 
of (9’) 

fi(Q1) = fi(O) = gi) = 90) = hil) = 20) = 3, 

@ = 1,2;3 = 1,2,3;k 

Hence for the c.p. “among” the groups 

(G3 = 2-3-3 = 3, ete. Hence c3 = cy = C3 = +++ = Co = 
in exact accordance with Morgan’s idea of linkage groups. If each group con- 
sists of only one element: U(11, %2, +++, %m) = f(x:)g(ae) +--+ k(am) it follows 
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that f(a) = g(a) = --- = k(am) = 3 for x; = 0, 1, hence I(x, , --- , %m) = (4)" 
for all combinations of the arguments and we have again free assortment. 

(iv) Groups of completely linked characters. Combining and generalizing the 
ideas of (ii) and (ili) we may speak of 7 groups of completely linked characters if 
within such a group no crossover takes place. Then the m; characters in each 
group act as one character. An example will suffice. Suppose m = 9 and three 
such groups, consisting of the characters 1,2, and 3,4,5, and 6,7,8,9 respec- 
tively. Assume that 


I(11, 111, 1111) = 1(00, 000, 0000) = a, 1(00, 111, 1111) = 1(11, 000, 0000) = C, 
1(11, 000, 1111) = 1(00, 111, 0000) = C2, 1(11, 111, 0000) = (00, 00, 1111) = C; 


where these four numbers are #0 and with sum 3; hence all other probabilities 
are zero. It follows that the c.p. ‘‘within’”’ the groups are all zero: cy = cy = 

* = Cy, = Cor = +++ = Cyg = O, but the ‘“‘among”’ c.p. are different from zero, 
€.2. C13 = Cia = Cig = C23 = Coy = Cop = 2C, + 2C2 and, with an obvious notation: 
Cro = 2(C, + C2), erm = 2(Ci + Cs), Cn,mr = 2(C2 + Cs). 

A particular case (also a particular case of (iii)) arises if the l.d. resolves into a 
product of some distributions such that there is complete linkage in each of these. 
The “within” crossovers are then again zero but all the c.p. ‘‘among”’ the groups 


equal 3. 
































5. The case m = 2. It will be easier for the reader if this case, though it 
has been investigated before by several authors [16], [7], [14], will be presented 
by means of explicit computations before attempting the general one where m 
and r are arbitrary. 


If m = r = 2, the number of types (a1, 225 y1, ye) equals ten. The L.d. is 
completely determined by the c.p. ci = c and v.v., because 1(10) = 1(01) = c/2, 


1(00) = 1(11) = (1 — c)/2. Now let p‘”’ (a, , x2) be the probability that in the 
nth generation a male (or female) individual transmits the genes x; , x2 ; and de- 


note by p;”’(a,) and p3”’(x2) the respective marginal distributions. The formula 
corresponding to (4) then becomes 
p”(1,1) = vo (1,15. 1,1) + 4v (1,1; 1,2) + 4v (1,1; 2,1) 
(19) a . 
+ += "(1,15 2,2) + £0(1,2; 2,0, 
2 2 

and three analogous formulae. To understand this, consider e.g. the last term 
of (19); it is the probability that an individual be of type (1,2; 2,1) or (2,1; 1,2) 
and transmits the set (1,1). By (19) p‘” (a, 22) is deduced from the given 
distribution v‘” of genotypes. 

If, as before, x and y are written for x; , x2 and y; , y2 it is to be understood that 
x = y Means x, = y; and x2 = y2. The relation corresponding to (5’) takes 
then the form 









(n+l ( 


py” (z)p\"(z4) if x= 
2p" (x)p'"(y) if x 


U 


3 Y) 


| 
© 


(20) 


YK 
eS 
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Applying (19) to the (n + 1)st generation and using (20) we get the recurrence 
formula 


PP, = PPa.DF + p,)p",2) + pL, Dp (2,0 
+ (L — e)p (1,1)p (2,2) + ep (1,2)p (2,1). 


Here the right side can be rewritten so as to give 


(21) 


(22) p(1,1) = (1 = ¢)p' (1,1) + epi” (1)p3” (1) 


and three analogous formulae. Because of (7): 


(22’) pr? (a »%) = (Ll — cp” (a1 »X2) + cp,” (x1)p2” (22). 


From this recurrence formula, which has the particularly simple property that 
the second term on the right side is independent of n, it is easy to derive step 
by step: 


(23) p (a1, a2) = (1 — c)"p (a, 22) + [1 — (1 — ©)"Ipi” (ai)ps” (22). 
Hence, if c + 0: 


(24) lim p’ (21, t2) = pt” (x1)ps” (a2). 
The preceding results were obtained by Robbins and Jennings. We will formu- 
late a theorem after having studied the general case of arbitrary m and r.’ 


6. The general recurrence formula. Considering random mating and assum- 
ing general linkage, we now wish to find the relations which correspond to the 
formulae (19)—(22) in the case of m r-valued characters. It will turn out, that, 
by using the l.d., the following proof of the general case becomes surprisingly 
simple compared with older investigations of the particular case of free assort- 
ment, the values of the l.d. acting somehow as natural ‘‘separators’’ for certain 
groups of terms. 

Denote by w\" (a1, +++, 2m 3 Yry*** > Ym) = w'" (x; y) the probability of a 
genotype whose maternal genes are the x and whose paternal genes the y. Then 
from (a”): 


(n 


(25) w" (2; y) = wy; 2). 


Writing « = y if and only if 7; = y;, (¢ = 1, --- , m) we put just as in (2) 


. v™ (x;y) = w'” (a; 2), ife=y 
(25’) 


w'" (a3 y) + w'(y; 2) = 2w'” (x; y), ifx ~ y. 


7A suggestive remark, repeatedly made by Professor S. Wright states that (assuming 
random mating) there can be no equilibrium until all of the factors are combined at ran- 
dom. This is indeed a necessary condition for stability. 
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There are 7°” w-values and 3r”(r” + 1) v-values in each generation the respective 
sums being always equal to one. Denote by p° (a, --- , %m) the probability 
that a male (female) individual of the nth generation transmits the genes x, and by 


ps” (xi), Di; (i, Lily °° * y Pid---m(M1, °°, tm) = p(t, °**, Lm) 
the corresponding marginal distributions, defined as usual (see (9)). Sometimes 
it will be convenient to denote such a marginal distribution by pa(z4) = pa(z) 
where A C S, and pa(z) is the sum of all p(x) such that x; = 2; for all 7 € A, 
Following convention the subscript will be omitted if A = S; hence ps(z) = p(z) 
and if A is empty, 4 = 0, the corresponding po(z) = 1. 

To simplify the writing p(x), v(x; y), ete. will be written instead of p’”’(z), 
"(as y), ete. and p’(x), v’(x; y), ete. for p\"~" (x), ete. Finally, rer.ember that 
I(A) is the probability that the paternal genes of A and the maternal genes of 
A’ = S — A will be transmitted and accordingly /,(A;) is the (marginal) prob- 
ability that the paternal genes of A, and the maternal genes of A ~— A, will be 
transmitted. (S D A D 4A)). 

Let us derive p’(z) from p(z). From the meaning of the different distributions 
we gather that 


(26) p(z) = =l(A)w(a; y) 


where A is an arbitrary subset of S and x and y such that 


y¥i= 2 for teA 
(a) 

R=2z “ teA’, 
In fact, the set z will be transmitted if and only if an individual possesses these 
genes and also transmits them; now consider any /(4) i.e. the probability to 
transmit the paternal genes of A; this probability is to be multiplied by all 
possible w-probabilities which contain as arguments the paternal genes of A 
and the maternal genes of A’, as stated in (a). Now let us write (26) also for 
the (n + 1)st generation: 


(26’) p'(z) = S1(A)w’ (a; y). 
Next we have, just as always, [see (5), (20)] 

(27) w' (x;y) = w'(y; x) = p(x)ply). 
Hence from (26’) and (27) follows 

(28) p’(z) = S1(A)p(x)pty) 


with the condition of summation given by (a). 

The right side of (28) contains (27)” terms. Now we will write it in two 
different ways by collecting its terms under two different aspects: (i) arranged 
according to the marginal values of the /-distribution (ii) arranged according to 
the marginal values of the p-distribution. Let us begin with (i). 
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The genes 2; , 22, °°* , 2m can be transmitted only by individuals which possess 
each z; either before or after the semicolon or both; (either from the mother or 
from the father or from both parents). Hence, if A; and A, are two disjoint 
subsets of S, the type of such an individual is such that 


%iA~2, yi =2z forall te A; 
(b) Lpo=2zjy, ysA2e “% % jeAs 
i= Yk = 2, 6“ “ k € Ss a Aj — As ; 


Hence the paternal genes of A; and the maternal genes of A. must be transmitted 
end for the remaining genes either choice is admissible. Consequently, each 
w'(x; y) in (26’)—or, what is the same, each p(x)p(y) in (28)—is multiplied by 
the probability that the paternal genes of A, and the maternal genes of A» are 
transmitted. Now writing A; + A, = A this last probability is exactly the 
marginal probability 14(41) = la(A:). Thence 


(29) p’(z) = =p(x)p(y)la(Ai) 


where the sum is extended over all pairs x, y defined by (b). This is a first 
recurrence formula. If in (29) w’(x; y) is written instead of p(x)p(y) and then 
all accents are omitted we get 


(30) p(z) = =w(z; y)la(A1) 


with the summation according to (b). This formula is necessary in order to 
derive p(z) from the given distribution w(x; y) of genotypes. It corresponds 
to (19). 

Now let us collect the terms of (28) in the second way. Let us determine 
the factor of any /(A) in (28), e.g. of 1(1,1,0,0,0) (where m = 5 and A the sub- 
set 1,2). Any factor of /(1,1,0,0,0) must be of the form p(z,, 2, -,-,-) 
p(-,*,23, 24, 25) Where all possible values of the variables must be written on 
the empty places marked by points, and the sum of all these products is to be 
taken. Now, as in each of the two p’s on each of the free places all numbers 
between 1 and r have to be used, the sum of all these products resolves into the 
product of the respective sums of the p’s. In such a sum each term, on the 
places belonging to A contains the same fixed values z4 and on the other places 
any possible value combination; hence such a sum is precisely the marginal 
probability pa(z4) = pa(z) and the same holds for the other sum of the p’s and 
for A’ = S — A. Thus we get the second, even more important recurrence 
formula 


(31) p’(z) = 2d U(A)pa(z)pa (2) 


where the sum is over all subsets A of S. This formula corresponds to (22) 
and the limit theorem which will be proved in the next section is an almost 
immediate consequence of (31). It is worth noticing that the derivations of 
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(31) and (29) from (28) are completely independent of each other and that only 
(31) is needed for the limit theorem 
From (29) and (31) the interesting identity follows 


(32) 2 l(A)pa(z)pa(z) = Sp(x)p(y)la(Ar) 


which somehow reminds us of a general Abel-transformation. 

Let us summarize: (i) From a given distribution of genotypes w‘" (or v) 
the p‘” are derived by (30). (ii) From these p'"’ the w‘"*” follow by (27) 
(or v‘"*” by (25’) and (27)). (iii) Instead of step (ii), from p‘” the consecutive 


( 1 2) (n+ e e ° 
pr? p\"*™ .-., p'"*” may be derived directly by means of (31). Finally, 


if desired, w‘"*’*” follows by (27). 
As an illustration of these formulae let us write (31) for m = 3,4,5: 


p'(x1, 22, Xs) = 2[1(000)p(xi, x2, xs) + 1(100)pi° (21)prs(ae2 , Xs) 
(31’) + 1(010)p;° (x2)pis(ai , 23) 
+ 1(001)ps” (x:)pu(a , 22)] 
p' (a1, 2, X3, 44) = 2[1(0000) p(x , xe , Xs , 14) 
+ 1(1000)pi” (x1)poss(we  @3 , 24) + °° 
(31’’) + (1100) pi2(x1 , x2) psa(Xs , La) 
+ 1(1010)pis(21 , X3)Pes(X2 , 24) 
+ 1(1001)prs(a1 , 24)pes(x2 , Xs)] 
p' (a1, 2, Xs, 4, Xs) = 2[1(00000)p(a1 , --- , 2s) 
a”) + 1(10000)pi° (x1) posis(%2 , U3, 4, Vs) + +e 
+ 1(11000)pio(21 , 12) psss(@s, Xa, Us) + °°]. 


In the last formula the last group contains ten terms. As an illustration of 
(30) we write e.g. for m = 3, r = 2, with p'” = pandv™ =v: 


p(x, X25, 3) = v(X1, X2, X33 X1, X2, Xz) + Z[v(Xi, Xe, Ws 3 Yr, Xe, Xs) 
+ v(t, 2, 133 %1, y2, Xs) + °°] 
+ [h2(OO)v(a1 , Xe, Xs 5 Yr, Yo, Ls) 
(30’) + 3(00)o(21 , 22, 35 Yr, T2, Ys) + °°] 
+ L(000)v(a1 , T2, X35 Yr, Y2» Ys) 
+ [1(100)o(y: , re, Xs 5 Xi, Yo, Ys) 
+ 1(010)v(21 , yo, X35 Yr, M2, Ys) + °°*]. 


nly 


( n) ) 
27) 
tive 
lly, 


13) 


ee 
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7. Limit theorems. In order to find lim p'”’ (x, , --- , am) we write the recur- 


us 


rence formula (31) in the form 


(33) p(x) — 2100 --- Op’ (z) = do’ W(A)pS” (z)pS” (2). 


(A) 


/ e ’ . . . 
Here 7 means a sum over all subsets A of S which are neither void nor equal 


(A) 
to S. If we write gq,” for the right side of (33) and p(x) = p,”, 
21(0, --- , 0) = am the last equation takes the form 
(34) ~~ -ea” = &”. 


Consider first the case a, = 1, or (0, --- ,0) = (1, ---,1) = 4, i.e. complete 
linkage, as defined in section 3. In this case all /(4)-values on the right side 
of (33) are zero, hence q,,” = 0 and 
(35) — «-” (n = 0, 1, 2, ---). 
This is exactly the same result as (7): All Dn are equal to Pn and because of 
(27) also 
(36) w"(x;y) =wi(asy) or v'(a;y) =v (x;y) (n = 1, 2, vee). 
In fact, if the characters are completely linked, they act as one character. Hence 
we have 

THEOREM 1. I[f them Mendelian characters are completely linked, the distribution 
of genotypes reaches the stationary state in the first filial generation. 

Now consider (34) in the general case where 0 S a,, <1. Then the following 
lemma will be used: Jf in a recurrence formula of the form (34), | am| <1 and 
lim Gm = Gm exists, then lim p,” = Pm = Gm (1 — @m). This can be proved 


no us 
directly in various simple ways. It may also be regarded as a consequence of 
well-known general convergence theorems. See also [15]. 

In order to apply the lemma let us first notice that q exists. In fact, 
pr (x1, x2) — 21(00)p'" (x, , x2) = 21(01)p;” (21)p2” (x2) and as the right side 
is independent of n, q. certainly exists. Hence, it follows from the lemma that 
p. exists. For m = 3 the recurrence formula (31’) shows that ¢3" contains no 
marginal distribution of p of an order higher than two; therefore each of the 
terms of qg3". approaches a limit, hence q; = lim q;" exists, and consequently, 

nus 
because of the lemma, p; exists. We may continue in this way because in (33) 
all marginal distributions of p on the right side are of an order S m — 1. Hence 
for every m the q;,”"’ approaches a limit and consequently the lim p,,"’ exists. 


n->o2 


Finally, in order to find p,, we notice that q = (1 — a2)pi” (21)ps” (22), hence 
Po = pi (a1)ps” (x2). Then, assuming that poo = pi’ (rr) --* pea(am—r) 
we see from (33), using (8), that gn = (1 — am)pi’ (41) +++ Dm (tm). (See 
also (31’) (31’’), (31’”).) Thence 
(37) lim p’” (x1, 22, °°* , tm) = pi (a1)ps” (ze) «++ pa (tm). 

no 
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The last formula contains the limit theorem we wished to prove. It can be 
stated as follows: 

TxHEorEeM II. Jf m characters are arbitrarily linked, with the one exception of 
“complete linkage’, the distribution of transmitted genes p” (a, +++, tm) “con- 
verges towards independence.’ The limit distribution is the product of the m 
marginal distributions of the first order p; (x;), which are derived from 
p (a1, -**, am), the distribution of gametes in the initial generation. 

If, however, the initial distribution p‘”’ (x , --- , x..) shows particular features, 
the stationary state may be reached already for a finite value of n. This happens 
with n = 0 and for every Ld. if po°(ay, «++, 2m) = pi (ay) «++ pe’ (am). In 
other particular cases it may happen under particular assumptions for the 1.d. 

Let us express the general result also in terms of the distribution of geno- 
types. It follows from (37) and (27) that 
+1 


lim w'"*? (a; y) = lim p? (x)p (y) 


n> co n—>oO 


m 
(0) 


— (a1) ++ Dm (Xm)ps” (yr) a8 Dm (Ym) = L [ps (xi)pt” (ys). 


(0) 


Now consider a product like p{?(x)p{(y;). By definition of p{° (a1) and ap- 
plying (27) we find 


pi” (21)p1” (ys) = a ie p>» Pp (a, ee Lm) >» ee Ss p "(ys ie, Ym) 


ee 


= 2 dh pop) 


Zz2 Zim 42 
m Y2e°* sm 
Introducing then in a natural way the marginal distribution: 
(n) : 
wi (Ti 5 Yi) 
(38) . 
= z 7 w (try °°* 5 Ls Yts °° * > Yn) 
Tye eB im iZit ie’ elm Yio Yi— Lisi’? *sYm 


it is seen that 
(39) Ds” (ape? (ys) = wl} (xi 3 yd). 
Thence the result 


(40) Fim war 2 Bm 5 Yay ty Ym) = WY (5 Yn) +++ Wn (Tm 5 Ym) 
no 
which may be stated as follows: 

TuHeoreEM III. Jn case of m arbitrarily linked Mendclian characters the distri- 
bution of the genotypes in the nth generation, w"' (a1, +++ 5 m3 Yr5°** y Ym) 
“approaches independence” asn — x. The limit distribution is the product of 
the m marginal distributions w'’(x;; yi) of the ith character (i = 1, +--+, m) 
in the first filial generation. 

This theorem, which may be regarded as a corollary to THEOREM II, holds for 
any type of linkage, except ‘complete linkage”? as defined in (17) where (36) 
is valid. 
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8. Solution of the recurrence equations (31). Formula (31) expresses 
p” (1, °** » tm) in terms of p” ?(a,, -:+, am) (and all marginal distributions 
of p'"’) and of the l.d. It seems desirable to try to express p‘”’ (x) in terms 
of p(x). Now (31) is not a single equation but rather a complex system of 
difference equations with constant coefficients because for each marginal distribu- 
tion of order i < m the respective recurrence formula (31) of order 7 has to be 
used. (Or, if it is preferred to consider the marginal distributions as sums of 
p-values of order m, then all these p-values appear simultaneously and there is 
again a complicated system of difference equations.) In this situation it is not 
to be expected that the integration will yield simple explicit formulae, partic- 
ularly as long as the l.d. is left arbitrary. However, the construction of the 
following formulae is clear. They reduce to simpler expressions in particular cases. 

Let us use a method of indeterminate coefficients. To simplify the writing 
denote p‘” (x1, --- , tm) and its marginal distributions p{° (x,), p{°’ (x; , x;), ete. 
by Piz,....m, Pi, Pi;,ete. From genetical as well as mathematical considerations 
we gather the general form of p;3”.., in terms of py...» and its marginal distribu- 
tions; that this is indeed the general form will be verified by our very computa- 
tions. Consider the set S consisting of the m numbers 1, 2, --- m and divide 
S in every possible way in two disjoint parts A; and A2, none of them 
being empty, so that A; + A: = S, then divide S in every possible way into 
three disjoint parts so that A; + A, + A; = S, and finally S is divided into m 
disjoint parts each consisting of one single element. Denoting the unknown 
coefficients in a corresponding way by as”, a" 4, , a4" 45,4, , ete. and writing ps” 
and ps for pi3...m and p}2'..,, the general form of ps will be 

Ds” = as” Ps + 7 a 11 he ty Mae + ye hes 943 PA, PAg Paz 
(41) (Ay) (A,,AQ) 
ote O11,3)3,.--4m Pi D2 Da °° Dm. 


This holds for every m. We get e.g. for m = 4 


(n) (n) ' y_{n (n) 
P1234 = Ay234Pi231 T(t ,234P1P 934 + 2 ,134P2P134 + ---) 


(41’) 


+ (a2.341234 + +++) + (a}2'3,4P12)3D4 + ses) + Qi,5'3 4P1P2PsDa 


For m = 6, e.g., there are eleven different types: One term aj”) .6p...6; then 
6 term¢ of the form @;,3:..sprpes...6; 15 terms like aj3'3456P12Psiss ; 10 terms like 
0193,456P3Pas6 3 15 terms like at.3/3456Pipopsise ; 60 terms like a}.>3,456P1P23D186 3 
15 terms like ajs31,ssPw2PsiPss ; 20 terms as aj.o,3,456P1P2PsPiss; 15 terms as ° 
12,34,5,6D12)31PsPe 3 15 terms as ay.o3,4,56P1P2P3Pspss; and one final term 
Q41,9,3.4,5,6P1P2P3pspsPo - 

In (41) the a‘”’ are unknown constants depending on n and on the Ld. 
In order to find them consider (31) and write for the values of the l.d. v} instead 
of 2/(4) (no confusion is possible because no marginal distribution of the Ld. 
occurs in (31)). With this notation (31’’) e.g. reads: 


‘ / n+1) i Y | 7.4 n) ; { n) n 
(31’ P1234 = UePi931 TT Wipipess + se — (V2) 12 P31 + --: 
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If there is no ambiguity the upper m in vi may even be omitted. Now assume 
the equations (41) to be written for » = 2,4 = 3,---,u = m. Introduce into 
the left side of (31) the expression (41) for ps"~”’ and in the same way replace on 
the right side of (31) all p:"’, p{?’, ---, pis’... by their respective expressions 
(41). In this way an equality is obtained from which recurrence formulae for 
the unknown coefficients may be deduced by collecting all groups of terms which 
contain the same products of p’s. 
If this is carried out, e.g. for m = 4, the recurrence formulae are 


(n+1) 


a OED 
Q1234. = U0Q1234 


(n+1) ae ' «ee 
Q123,4 V0@123,4 TT V4Qj123 


Cee? 4 ee , ( 
Q12,34 U'0012,34 TF Ua 


n) (n) 
2 


34 


(n+1) ae = (n (n) ge) ee 
0319,3,4 = U12,3.4 + Vi2a12 A3,4 + Vs@i2,4 + Vseti2,3 


(n+1) . (n) (n) é (n)_ (n) 

= U901,2,3,.4 + U109,3,4 + + HE U1201,2 03,4 tee 

In general, i.e. for any m, these recurrence formulae are of a clear structure the 
first one being particularly simple, namely 


(43) aft? = mp0” 


It can be solved immediately and gives 


(43°) 


as” = uf. 


< 


The other recurrence formulae are all of the form 
(44) Ln+i = Von + f(n) with x = 0, 


where f(n) is a given function of n whose general form is still to be investigated. 
The solution of (44) is 


n—1 


(44’) tn = Di f(v)vo”. 


v=s() 
With the notations used in (41) the equation (44) may be written: 


wu” (n+1) —— (n) (n) 
(44 ) pnt A = V0QH4 1,49. Ay + 4 4A gt A 


ue 


We have to determine A4,,4,,....4,. For reasons of symmetry and homogeneity 


(n) 


let us introduce constants aj" = a." = --- =a," = 1. With that notation 
’ e.g. the last term in the second line in (42) reads v,a;33 a," or the third term to 
the right in the fourth line of (42): vzajei4a3”" ete. 

The construction of A‘,.4,,....4, may then be described as follows: Each 
A‘, ,49,....4, 18 a sum of 2“ — 1 terms, each term being a product of one v-value 
and two a’s. The set consisting of the uw elements 4;, A2,--- , A, is to be 
divided in all possible ways into two non-empty, disjoint, complementary parts 
which form the subscripts of the two a’s in question; the subscript of v is equal 
to the subscript of either of these two a-values; it makes no difference which, 
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because of the specific symmetry (8’) of the 1.d.; it should be noted that in the 
subscripts of vno comma occurs. As an example let us write A{234,s67,3 for m = 8. 
We get: Aj23s,s67,8 = Users” 334,567 + Usererser aiaa4,s + Vi2ssQjsasase78. Or if we wish 
Aj3,34,5.6 for m = 6: A}334,5.6 = Veaeg” 32.3 34,5 Tt UsQ5" 013-34,6 + 9 1213 O33'3.6 + 
340134 O112,5,6 + suk? ad + V1250119,5034.6 + 01260112,60035.5 . 

Hence, in principle our “‘integration’”’ problem, where n is the variable, i: 
completely solved: First ps” is given by (41). Then, in order to find any 
tw 1, , We first determine the corresponding A 4,,4,,...4, by the rule just 


explained and illustrated, and then it follows from (44’) that 


(44"”’) Or ae ™ ve l—» ai 
v=0 

This whole procedure, although in principle very simple, may of course be lengthy 
if m is not small and if no specific assumption for the I.d. is considered; for in the 
expression of A 4,,4),...,.4, many different a-values appear,—each however with less 
than m subscripts—which play the role of abbreviations for complicated ex- 
pressions; in other words the explicit solution for m = 6, for instance requires 
the solutions for m < 6, all these solutions being however completely given by 
our formulae, down to m = 2, where aj; and aj’ are given by (23). 

Under simple assumptions for the ].d. the explicit expressions for the a become 
simple. Two extreme cases are complete linkage and free assortment. In 
the first case pj3)..m = pi2’..m and nothing remains to be done. The case of 
free assortment where all v = (3)” can be dealt with directly by induction, or 
we may evaluate the general formulae given above which in this case become 
quite simple. We have 


(45) 2a aca, = 2"(2" — 1) +++ (2"— w+ 1). 


That shows that the values of the coefficients a‘"’ depend only on the number of 
elements A; which appear as subscripts. Thus we find e.g. for m = 6, if we 
write in each line of (45’) one typical value: 


ales = 2"/2 = 1/2" 


(n) (n) (n) n seen 
11,2346 2,2 123,456 (2 i 1)/2 


1,9) 3456 Sas = atfdens = (2" — 1)(2" — 2)/2" 

aft us = alSse = (2” — 1)(2" — 2)(2" — 3)/2" 
193456 = (2” — 192” — 2) --- @" — o/2”" 
O42 345.6 = (2” — 1)(2” — 2) --- (2” — 5)/2™. 


Thus in the simple case of independent assortment the explicit solution is very 
simple too. It confirms the fact that lim @},3’s,1,5.. = 1 while all other a’s approach 


no 
§ The values on the right side of (45) are indicated in [1]; but the solution for free assort- 
ment reported in this article does not seem to coincide with ours. 
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zero. To prove this, however, without recurring to computations, was the 
purpose of the preceding section. 


9. Crossover distribution and crossover probabilities. The limit theorem of 
§7 as well as the computations of the preceding section, in short, all investiga- 
tions and concepts considered so far, are valid for any l.d. We shall now define 
and use a crossover distribution, (c.d.), which is completely equivalent to the 1.d. 
but preferable for the study of certain particular cases. Apparently biologists 
have not considered the general concept of the e.d. but only the e.p.¢;. This 
concept is basic and tangible but not sufficient for a complete description of the 
linkage mechanism when m 2 4, as was seen in the preceding sections. 

It is obvious that, from our point of view, a mathematical theory of linkage 
must be based on the properties of and a set of assumptions on the I.d., or the e.d. 
The linear theory will be considered from this standpoint. This theory is, of 
course, still compatible with a variety of particular assumptions. In the last 
section some simple particular cases will be presented and studied with a special 
view to interference. 

The probability that an individual transmits the set of ‘‘paternal genes’’ be- 
longing to A and the set of ‘‘maternal genes”’ belonging to A’ = S — A is denoted 
by 1(A), where 1(A) = 1(A’); e.g. with m = 8: 1(1,0,1,1,1,0,0,1) = 1(0,1,0,0, 
0,1,1,0). Considering here the succession of arguments we see that in either set 
of eight arguments: The first and the second are from different sets, the second 
and the third are again from different sets, the third and the fourth are from the 
same set, --- the seventh and eighth are from different sets. Writing 0 for 


‘same’? and 1 for ‘‘different”’ and using these numbers to correspond to the 
(m — 1) consecutive intervals between the m genes, we introduce: 


1(10111001) + 1(01000110) = (1100101). 


Here w(m, 72, °°* , %m-1) Where n; = 0 or 1, is an (m — 1)-variate alternative. 
The relation between the |.d. and this new distribution may be written in the 
form 


(46) (er, €,°°°, €m) = wl) — ©], | € — 31, °°* | €m-1— Em |), € =OOrl. 


In this definition no fixed ‘order’ of the genes is implied so far. The numbers 
1,2--- m are used like names. 

But it seems to be admitted today by leading biologists that a certain natural 
order of the genes exists. If this is so the numbers 1,2. --- m should be used 
in agreement with this order. Let us note, however, that the situation is in 
reality slightly different : Only the genes within each linkage group ($4) are assumed 
to be ordered, whereas no order exists among the groups. Let us for the moment 
disregard this circumstance and assume that all genes under consideration 
belong to the same linkage group. 

Within such a linkage group a one-dimensional or linear order prevails, to be 
understood in the geometric sense of “location”. Some more precise definitions 
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concerning this linear order will be considered later. For the moment we simply 
imagine that each of the two sets of genes belonging to an individual is arranged 
like m consecutive discrete points on a line segment.” The crossover distribution 
m(m, 2, °** m1), introduced in (46) becomes more meaningful under this assump- 
tion where, now, the numbering corresponds to this linear order. Then the 
argument 0 in this distribution can be interpreted as ‘‘coherence” and the argu- 
ment 1 as “interchange” or “‘crossing over’ and the “intervals” as intervals in 
the geometric sense. Whether this “crossing over’, which means transition 
from the maternal to the paternal set or vice versa, is to be conceived as a 
“break”? (Janssen’s chiasmatypie) does not matter for the above definitions. 
If however, the idea is that between two neighboring genes not more than one 
break is possible then the ‘‘event,’’ which we call crossover, would be at the 
same time a break; if, biologically, more than one break between 7 and (i + 1) 
is not excluded, then the event ‘‘crossover within (i, 7 + 1)” means “‘odd num- 
ber of breaks within this interval.’ 

Now, let us consider the relation between the c.d. and the ¢.p. It has been 
repeatedly remarked that the c.p. are not equivalent to the 1.d., hence they are 
not equivalent to the c.d. either. There are 3-m(m — 1) ep. but 2"”* —1 
l-values, or z-values. If m 2 4 the second number is greater than the first. 
Besides, the /-values are absolutely arbitrary probabilities. For the c.p. in sec- 
tion + some restrictions were derived. Let us derive another set of restrictions 
by considering four numbers 27, 7, k, 1 which we may denote by 1, 2,3, 4. (The 
following computation has nothing to do with linear order. It applies 7f m = 4 
to the 1.d. l(e.ecese;) and if m > 4 to the respective four-dimensional marginal 
distributions of the ].d.) Write v(eeceses) = 21(€:€2€3€,) and let us add up the 
six ¢.p. corresponding to these four numbers. From ¢;; = 2/;;(1,0) = v;;(1,0) 
we get 


Cie + Cis + +++ + Ca = 3v(1000) + 3v(0100) + 3x(0010) + 3v(0001) 
(47) + 4v(1001) + 4v(1010) + 40(1100) 
= 4 — 4v(0000) — v(1000) — v(0100) — v(0010) — v(0001) S 4. 
Hence as by (14) cig + G3 + C3 S 2, it follows that 
(14’) ca + ta+ te $2 


is another necessary condition for the c.p. The limit ‘‘2” can be reached, as we 
see for v(0000) = 2(1000) = v(0100) = v(0010) = v(0001) = 0; then 


Cy = C34 = ¥(1001) + v(1010) 
C23 = Cy = v(1100) + v(1010) 
Ci3 = Coy = ¥(1001) + 7+(1100) 
’** The genes are represented as lying in a line like beads onastring. The numerical data 


from crossing over show in fact that this arrangement is the only one that is consistent with 
the results obtained”’ [11]. This is but one of many statements in favor of the linear theory. 
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and 
Cie + C23 + Cig = Cra + Coa + Cae = 2. 
To summarize the facts about the e.p.: In case of m characters there are 


4m(m — 1) e.p. c:; = 21;;(10) = 21;; (0,1). These values must satisfy the follow- 
ing necessary conditions (besides 0 S c¢;; S 1): 


(13) Cij t+ Cre = Cz for any three subscripts 
(14) Ci3 + Ca + Ca S 2 vs = - 
(14’) Cu t+ Cu + ew S 2 


If in an analogous way five or more subscripts are considered no new condition 
turns up. It has, however, not been proved that the above given necessary 
conditions are sufficient for a consistent system of ¢.p. If we wish to be sure of 
consistency the starting point must be a ld. or a e.d. from which the c;; are 
deduced. 


*¢ four 


[This question of consistency belongs in the same class as the following problem: 
m 
2 
ginal distributions of second order of an m-dimensional distribution V(x, --- , 
tm)?” Here V(a1, -++ , 2%») is the probability that the first result is S x2, the 


‘‘Under what conditions does a set of ( 


) distributions V;;(x;, z;) form the mar- 


second S x, the last S x,,. An analogous question arises for the set of @ 
distributions V;;(a;, 2;, 7), ete.’ 

In the following it will be necessary to know the expressions of the c.p. in terms 
of the c.d. Put m — 1 = n and denote by p;, p:;, ete. in the usual way the 
following probabilities derived from the ¢.d.: p; is the probability of ‘‘success’’ 
in the 7-th trial, p;; the probability of success in both the 7-th and j-th trial, ete. 
It has to be kept in mind that for the e.d. and all magnitudes derived from it the 
‘@-th trial’ is associated with the 7-th interval, i.e. with the interval (7, 7 + 1) 
‘and success in the 7-th trial” means cross over in this interval. [Whereas in 
the l.d. and in magnitudes derived from it, like ¢;; = l;; (1, 0) the subseript 7 
denotes the i-th gene. (See (46)).] Now denote by S; the sum of all prob- 
abilities p; , by S. the sum of all p;;, ---. Besides, let P;,...;(x) be the probability 
of exactly x successes in the first 7 trials (¢ = 1,2, ---,n), and analogously, 
P,,.. (x) the probability of x successes in the 7 — 1 trials 2, 3, --- , 7, ete. Then 
the desired formulae follow easilv: First we have obviously 


Ciign = Di (¢ = 1,2, -+-,n). 


Because ¢;,:41 is the probability of one interchange between the genes 7 and 

7+ 11.e. of an interchange in the 7-th interval, of “success in the 2-th trial’. 
10 For one-dimensional distributions V;(x) the question is trivial because any set of m 

distributions V;(z) can be considered as the marginal distributions of first order of V(x, 
7 Zm) = Vi(21) nee V ultn e 





PROBABILITY THEORY OF LINKAGE 49 


Then ¢;,:+2 is the probability of one interchange between 7 and 7 + 2, i.e. of either 
an interchange in the first of the two intervals numbered 7 and 7 + 1, and no 
interchange in the second; or of an interchange in the second but none in the 
first. Hence ¢i,i42 = Piii(1), @ = 1,---,n — 1), because P;,;41(1) is just the 
probability of exactly one ‘success’ in the two trials numbered i and i + 1. 
In the same way we get ¢i,i4s = Pi,...is0(1) + Pi,...642(3), @ = 1, +--+ ,n — 2), 
because an interchange between 7 and 7 + 3 means either exactly one or exactly 
three interchanges in the three intermediate intervals. Hence we get altogether, 
with n = m — IL: 


Cisat = Ds 


(48) crite = Pi,i42(1) 


Cim = Py..n(l) + Py..n(B) + +++ Py...n(@i), where i = n if n odd, 
= n — Lif neven. 
Let us also express the c;; in terms of the S;. It is well known (see e.g. [3]) 


that 


(49) P,......(2) = ¢ (—1)"*7S, (x = 0,1, --- n). 
Applying these to (48) we easily find the convenient expressions: 
Cio pi , ete. 
(i + pe) — 2pyw = (Si — 2S82)12, ete. 
(pi + po + ps) — 2(pr + pis + Pos) + 4px 
= (S; — 2S. + 483)193 , ete. 
(Si; — 2S. + 48; — 8S4)1...4, ete. 


Sy — 28. + 48) + +++ + (=2)"Sna. 


10. The linear theory. Consider a linkage group of size m and assume for the 
moment that ¢;; # cx for all 7,7, and k. It seems that the main mathematical 
content of the linear theory can be summarized as follows: Jt is possible to 
establish in a unique way an order or a succession of the genes, such that for the 

m m(m — 1) ; _ 

@ = c.p. the (m — 1)(m — 2) inequalities 


9 


7 Cij < Ci, j41 (i 1,2,-°>,m — 2) s : 
(51) : (@ <j) 
Cis S Ci. (2 2, 3,°°°,;m— 1) 


hold. In this suecession j will be between 7 and k if cx, is greater than the two 
other ¢.p.c;;andc,. The two arrangements 1, 2,--- mand m,m —1,-:-:-, 
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-- 1 are considered as corresponding to the same order. Furthermore, this order 
is a straight-line-succession for which an additive distance relation holds (cf. also 
[4a] and [13]). Instead of the restriction ¢;; ~ cx it is sufficient to assume 
the weaker restriction, that in any triple ¢;; , Cx , ex; one ts greater than the two others, 
Without such a restriction uniqueness of the order no longer holds. E.g. in 
case of independent assortment where all c;; equal 3 any of the m: possible num- 
berings of the genes is equally admissible from the point of view of the linear 
theory. In the case of complete linkage where all c.p. are zero it will be logical 
to consider al] m genes as located in the same point. Obviously there are all 
kinds of intermediate cases. We shall come back to this point at the end of 
this section. 

Now consider again the case of ‘‘different’’ ¢.p. (in the above defined sense), 
Let us prove that there can be not more than one succession for which (51) holds. 
In fact it follows from (51) that also: 


(51’) Ci; < Ciz (¢@ = 1,2,---,m— 2) forall k>jJ 
and Ci5 < Ck; (@ = 2,3,---,m-—1) forall k <2, 


These are all together M = 2-1 + 3-2 + --- + (m — 1)(m — 2) = 2-("") 
Oo 


”) = MM /2 ‘between’’- 
3 

relations for m numbers, each of them being defined by two inequalities as 
“> < ex and cx. < cx (if j is between 7 and /); hence on the whole WZ such in- 
equalities. But these are the same as (51’), as we see by changing 2, j, & into 
j, k, iin the second equation (51’). Thus it is not possible to find two different 
successions which both satisfy (51). 

As to the metric of the problem, Morgan proposed originally that the value of 
the ¢.p. c;; should be used as the distance between 7 and 7. It has, however 
been objected repeatedly that this distance would not be additive; this is ob- 
vious since the triangular relation (13) holds for three subscripts (see also 
(50)." The equality ¢;; + cj. = cx holds only in the exceptional cases where 
multiple crossingover is excluded. It seems, however that an adequate defini- 
tion of distance is available if we try to formulate in terms of probability theory 
what the biologist had in mind. Let 7 2 7. The distance d;,;.; between 7 and 
j + 1 may be defined as the mathematical expectation of the number of crossingovers 
in (i,j + 1), i.e. in the 7 + I — 7 intervals between 7 and 7 + 1. Hence if 


inequalities. On the other hand there are all together ( 


11 For a geometric equivalent of m points with m(m — 1)/2 arbitrary distances we would 
have to turn to an (m — 1)-dimensional space. In fact it is well known that there are 
between k points in the plane only S: = 2k — 3 arbitrary distances, in space only S; = 
3k — 6, in r-space S, = rk — r (r + 1)/2. Hence for r= m — 1 and k = m: Sn = 
m(m — 1)/2. 
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P;....,;(2) denotes, as before, the probability of exactly x crossovers in these 
(j + 1 — 7) intermediate intervals the formula holds 


j+1-i 
(52) di. i41 = 2d, £F"s...4(2). 
= 
Of course, an appropriate unit may be used such that in practical use the distance 
becomes proportional to the d;; introduced above. 

The mean value to the right in (52) is well known for any distribution 
m(t1, °°* , Xn) Whether an ‘“‘independent”’ or a general distribution; (i.e. in our 
case: with or without ‘‘interference’’). Denoting in the usual way by 7z;(2;) 
the marginal distributions of first order of r(a, --- , 2,) and putting 2;(1) = 
p; = the probability of success in the 7-th trial, we get: 


(53) iis. = Di + Pitt tees + Dj 


and in the same way with k > 7 
jigs = Pjti t Doze tres + De 
dixti = Dit Digit +++ + Dm 
hence dj, j41 + @j41.441 = ding. , or in general: 
(54) dij + dx = di (@<j<hk), 


It may be mentioned that the additive property of the mathematical expecta- 
tion which was used here is very well known (particularly for independent events) 
but not always correctly proved. The proof is contained in the transformation 
expressed in the following equalities: 


j+1-t 


di jt = > xP;...;(x) 


z=0 


— 2 Zz ve ym (x + Vi+1 +++ > Bj) Wi,640,---4( Le cc 2 xj) 


Ti Fi+1 


=> dX es 2 (xi + Xiga + -°* + 2;)4(t1, 22, °°* , En). 


“n 


(For general distributions Stieltjes integrals replace the sums.) In (55) 
mt, °*:,2,) Is the given n-variate distribution, P;,....; the probability of 
exactly 2 successes in the successive trials numbered 7,--- ,j and 

- 2;) is the respective marginal distribution of r(a, --- , 2). 
The first equality in (55) is not obvious, while the second is rather trivial. From 
the second or third form of d;,;,: in (55), follows (53). The last expression in 
(55) shows that the expectation of any such sum as (x; + 2j4; + +--+ x;) can be 
computed with respect to one and the same distribution m(a, +--+, x,). 
Therefore the distance d;,;,; may also be defined as the expectation of (vj + isa + 

- + 2x;) with respect to the c.d. 
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Because of the first equation (48) we get from (53) 
(53’) Gs;5 = Cieta tH Cigssge HF oo°* + Cp-1,;. 


Hence the distance d;; 1s equal to the sum of the j] — i intermediate c.p. No difficulty 
arises for us from the obvious fact that always 


(53”) Ci; S d;;; and in general c;; < di;, 


because the distance d;; is defined by (52), or (55) and not as ¢;;. 

On the right side in (53’) stands the sum of certain ¢.p. We have repeatedly 
remarked that there may be hitherto unknown restrictions for a consistent sys- 
tem of c.p. Hence it is important to notice that there are no restrictions for the 
particular (m — 1) c.p. Ci, C23, °** 5 Cm-tym. They can be quite arbitrarily 
chosen because of ¢i,i41 = pi. Hence any geometric representation of m genes 
arranged on a straight line in arbitrary distances d;,i41 (( = 1, 2,--- m — 1) is 
surely consistent. E.g.m consecutive genes may be arranged with equal distances 
diz = dog = +++ = dnijm. Or some distances may be zero; then the respective 
genes are localized in the same point, ete. 

Finally, let us briefly consider the case of several linkage groups. According 
to §4 the ].d. then resolves into a product of several distributions; e.g. with 
m = 12: 


I 


l(e1€ gS €12) filereceses) fo( €secer) fs (€g€g€i0) fs (€11€12) 


(56) 


(3)'m(la — @|,)e@— |, |e — «|) 
mo(| 5 — €6|, | € — €7|) --+ ma(| en — e)). 


Then, as postulated by Morgan, the linear order holds within each of the k groups, 
whereas all c.p. among the groups are equal to 3. 

Let us conclude this section by transforming the basic conditions (51) of the 
linear theory by means of (48). This will be needed in the following section. 
Consider e.g. the condition ¢13 < ¢y4, i.e. 


(57’) Py(l1) < Piog(1) + Pirs(3) 

or C4 < Cy yields Po3(1) < Py23(1) + Pi3(3). Or in the same way: 

(57) Pys(1) + Prs(3) < Prrsi(1) + Prow(3) 

sil s(1) + Pr,...5(3) + Pr,....5(5), ete. 


Thus we may express the content of (51) as follows: The probability that the 
“event” happens an odd number of times in a set T; of 7 consecutive trials is less 
than the probability that the event happens an odd number of times in the set Tj: 
or in the set T’;41 each consisting of i + 1 consecutive trials where T:4; and T’,4; 
denotes respectively the sum of T; and either the immediately following or the imme- 
diately preceding trial. In this form we see again that the linear theory is an 
assumption, suggested by observations, and by no means logically necessary. 
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11. Some models of c.d.’s based on the linear theory. The simplest and 
very important example which has been suggested repeatedly is that of inde- 
pendent crossovers: 

(i) Independence. ‘The crossovers do not influence each other, i.e. 


(58) Dis = PiPj, Pisk = PiPiPe,**° 
That this distribution is consistent is well known; hence only the specific ine- 
qualities (48) or (57) have to be considered. Here the expressions P...;(x), 
used in (57) become very simple, e.g. with p; + qi = 1: 

Py..4Q0) = 21929394 + G1 P2934 + gepsds + 919293) « 
Then a simple computation shows: 
(59) Ci,jta — Cis = (Gi — Di) +++ (Qi — DiadDs 
5 

Cit,j — Cij = Dialgs — pi) +++ (Q541 — D341). 

These differences will be positive if all gq; — pi > 0 or all p; < 3. Hence: A 
consistent c.d. which fulfils the conditions (51) of the linear theory is the distribution 


of ‘independent crossovers” with basic probabilities pp = Ciinn ( = 
1, 2,--- m — 1), with the one restriction 

(60) Citi = Pi S 3. 

The distribution is completely determined by (58). If all p; = p = 3, we have 


the particular case of free assortment. 

Although this independence is more general than Mendel’s original assump- 
tion, Morgan, Haldane and others reported observations, not in accordance 
with this hypothesis. One crossingover seems to prevent others in a certain 
“neighborhood”. This phenomenon was named interference. It suggests that 
we have to consider the ¢.d. as a distribution of dependent rather than of in- 
dependent events. This will be done in the following pages. First consider 
the limit-case of: 

(ii) Complete interference or disjoint events. In this case we have 


(61) Pis = Die = °° = Pr2,....m1 = 0. 
Thence it follows that we have simply 
Pi 
(62) Cig = Dit Din 

Ciji4a = Pi + Digi + Pi4e, ete. 
In this particular case the ¢.p. are additive c;; = di;. It is obvious from (62) 
that in this case the conditions (51) of the linear theory are fulfilled. On the other 


hand it follows from (49), (for z = 0) and (61) that the system is consistent if 
and only if 


(63) Si=ptpmet::+pr 1 (n = m — 1). 


Coin = 




















ee ee - anna ” . ‘ 
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This is in accordance with the fact that nearly or exactly additive c.p. have been 
observed always in connection with very small p,-values. 

The most striking observation leading to the concept of interference was that 
Pi; S pip;, i.e. that double crossovers appeared less frequently than one would 
have assumed for independent crossovers, but that nevertheless they did appear 
sometimes. A particularly simple model of dependence or interference which 
starts with this fact, preserving however, the main structure of independence, is 
the following: 

(027) One-parametric model of partial interference. Assume as before (m — 1) 
basic probabilities p; and put 
(64) Pij = €EPiP;, Pik = €Pi Pi Pe, *** , ete. 0 Se 1). 
There is independence if « = 1, complete interference for « = O and partial 
interference for intermediate values of «. Let us first investigate conditions 
for the consistency of this distribution. Necessary and sufficient conditions 
for a consistent distribution of arbitrarily linked events are well known (see 
e.g. [3] (b) p. 239). Write m —1=n. Asystem of p;, pij,-** , Pr...n IS Con- 
sistent if it is possible to compute from these (2" — 1) values, 2" non-negative 
values m(m, 72, °°* Mn) (ni = 0 or 1) which have the sum one and are given by 
the formulae: 


m(11---1) = pye...n 
mw(11---10) = prg,...¢n-1) — Dry,.--n 


ore e eee eee eee ees eeeeee ee 


(65) r(110---0) = pro — Dy pin, + Dy Do Penne — °°* E Pian 
(n,) ny ne 


(00---0) = 1 — Do pay + 2 Do Paine — 10 HE Din 


nm ni 
Because of the symmetry of (64) it will be sufficient to check (65) by means of 
the relations (49) which can be obtained from (65) by collecting groups of 
equations such that the corresponding r(m , --- , 7.) show all the same number 
of l’s as arguments. Write P;....(7) = P, for the probability of x successes 
in the n trials where independent events with basic probabilities p; are con- 
sidered, and P, for the analogous probability corresponding to the distribution 


. . . Y cy? . 7 
(64) and introduce in the same way S; and S; where as before, Sz = Zpi;, 
S; = Upin, etc. We then find: 

/ y y Y 

. Pa = l — 1 ate ES —= €93 + “2 

(66) 

=P,+ 1 — e)(— Ss + S83; — Sgt +++) = Powe + (1 — §)Q — e). 
It follows that the expression Pye + (1 — S,))(1 — €) must be 2 0. For e = 0 
this condition reduces to (63), whereas for ¢€ = 1, there is no restriction at all. 


On the other hand this is the only restriction of this kind, because we find 


, , sf F sf // ; " a 2 ’ . 
P, = S; — 2S. + 3S; — 4S, +--+: = S; — 2eSo + BeSs — 46S, + --- 


= P, + (1 — (282 — 3S; + 48, -+-) = Pre + Sil 





en 
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This last expression is always 20 because of P; = 0, Si: 2 0, € S$ 1. Further- 
more we find for i = 2 that P; = Pye, hence always non negative. Therefore 
our system is consistent under the one condition (66). 

The additional restrictions corresponding to the linear theory have still to be 
considered. A simple computation yields the result 


Cj. - Cs = (I 2ep;)(1 — 2epigs) --+ (1 — Zepp-s)p; 
Cijg. — Cigt,jg1 = pi(l — Zepi4s) --- (1 — Zep;). 





which is, for « < 1, less strong than (60). 





These differences are 20 if p; S 


Hence we sum up: A consistent model of partial interference with one parameter e« 


to fit the observations can be obtained on the basis of n = m — 1 prob- 
abilities pi, Po, °** Pn by means of (64), if the condition 
(68) Poe+(L—&)1-2) 20 o SS14+, a 

= < 


holds and the additional restriction required by the ‘linear theory” 


IA 


. l 
(69) Pi % 


’ 


is satisfied. For « = 1 this reduces to “independent events” or ‘‘no interference’ 
with no restriction (68), and (69) reducing to (60). For « = 0 our model yields 
“complete interference” or ‘disjoint events” with restriction (68) becoming (63) 
and no restriction (69). If we say that this model contains one parameter only, 
the idea is that the p; are to be identified with the basic ¢.p. ¢:,:41. It might, 
however, seem adequate to consider € and p;, +++ , Pm—1 aS m available param- 
eters which may be determined from the observations by some appropriate 
method. 

(wv) An (m — 1)-parametric model of partial interference. Numerical data 
show (see particularly [4]) that interference is particularly marked i.e. p;; < pip; , 
if the corresponding p; , p; are very small, whereas for greater values of the p; 
we have more nearly the pattern of independence. ‘This is rather a striking 
fact, and seems to be well confirmed by observation. In these final pages a 
model will be studied which takes into account the circumstance that the amount 
of interference seems to depend on the magnitudes of the p;. It contains 
(m — 1) parameters, is therefore rather flexible, but nevertheless very simple. 

Assume m — 1 = n numbers e; where 0 < €; S 1 and form by means of n 
probabilities p; : 

(70) Ei: Di = Di (OS «¢ = 1) (¢ = 1, 2,---, n). 


We may choose ¢; small if the corresponding p; is small and larger if it is large; 
if the p’s are all of the same order of magnitude the e’s need not differ much 
either. Then we simply define: 


(1) pis = Dips, Dijk = DiPiPry** , Pi2...n = Pip2*** Pn. 
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Let us investigate the consistency of this model. In analogy to (66) we form 
with S; = =D); ; Si = =D: ; S: = ZDiD; , ete.: 
Po=1-4+8&—-—84-:- 
(72) a ” ” n _ . 
=(1-5+8-84+---)-DVd-«p =P - 2 — «dp, 


i=1 i=l 


3 


/ TN eye, ° . . 
where Py and Pp are the probabilities for zero successes for the model under 
consideration and for independent events with basic probabilities p; respectively; 


hence Py) = [] (1 — e:p,) and we get the condition: 


t=] 
n if nm n n 
73) [T[d-ep) =D Ad-«)p or: Dv s Dp +I — do. 
i=1 (= 1 t=1 $=] t=1 
If all e; = | there is no restriction (73), while for e; = 0 we find again (63). The 
° . . / . ioe . 
consideration of P; , Ps, --- yields no new condition, because we get, denoting 


by P; the probability of 7 successes for the independent events with basic prob- 
abilities p; : 
P\ = Si = 28. + 383 6 o0) Se ns, = 8: = 25. + 2+ - nS, +- > pill —_ €;) 


i=1 


= P,+ Zz. p(l —«) 2O and: 


t=1 


P; =0 (i => 2). 


— 
_™ 
I 


As tor the restrictions imposed by the linear theory we find: 


(74) Cin — Cis = (1 — 2p,)(L — 2pizs) --- (1 — 2pj-1)p; + pl — €;) 
‘ 


4,344 — Cs41,344 = Pl — Biya) --- (1 — 2p;) + pl — &). 


Thus the conditions of the linear theory are satisfied if 


— x l 
(75) BiS4torps —. 
2e; 
Hence summarizing: On the basis of m — 1 probabilities p; a consistent model of 


partial interference is obtained by means of (70) and (71) if the condition of con- 
sistency (73) and the conditions (75) are satisfied. 

It may be that the four simple models described in this section will seem too 
crude for the description of the complex mechanism of linkage. They could, 
of course, be combined and modified in various ways in order to serve at least 
as an approximation to the theoretical picture of reality we wish to construct. 
But, while these particular attempts may be inadequate, it seems to the author 
that the underlying principle is not wrong: that a mathematical theory of 
linkage must finally consist in statements on the l.d. (or the equivalent c.d.). 
The consideration of the c.p. is not sufficient for this purpose. The mathe- 
matical instrument for a theory of linkage seems to be the probability theory of 
the linkage distribution. 


- 
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THE COVARIANCE MATRIX OF RUNS UP AND DOWN 


by Hl. Levent ano J. WoLrowrrz 
Columina University 


1. Introduction. [Let a,,--- , a4, ben unequal numbers and let the sequence 
S (hy hy, ss hy) be any permutation of a, -++,a,. Sis to be considered 
a chance variable, and each of the n! permutations of a), +++ , @, is assigned the 


wT ‘ ° “th ° : 
dame probability. Consider the sequence 2? whose 7 element is the sign (+ or 


dob hays h,,@ Fy Se 1). A sequence of p consecutive + signs 
not immediately preceeded or followed by a + sign is called a run up of length 
p; a sequence of p consecutive — signs not immediately preceded or followed by 
i sign is called a run down of length p. The term “run” will denote both 


runs up and runs down. The usage of the term “length” varies; most quality 
control literature attributes the length p -4+- 1 to the runs which we say are of 
length p. 


As an example of our usage, the sequence 


S= 28131347 
gives the sequence 
R a ep ay 
which has a run up of length 2, followed by a run down of length 1, followed by 
norun up of length 3. 

Runs up and down are widely used in quality control and have been applied 
to economic time series. ‘The purpose of this paper is to obtain their variances 
nnd covariances and to correet some erroneous notions prevalent in the literature 
about their application. 


2. Notation. If the sign (+ or —) of (hiv, — A) is the initial sign of a run 
defined as above, we call A; the initial turning point (i. t. p.) of the run. Then 
hy is always an i. t. p., and we adopt the convention that /, is never an i. t. p. 
We define new stochastic variables as follows: 


}1 if h;is ani. t. p. 
(2.1) ‘* 1 if Ayis aun i t. p., 
\O otherwise, 


22) ia it if hy is the i. t. p. of a run of length p, 
\o otherwise, 
(23) i (1 if hy is the i. t. p. of a run of length p or more, 
. \O otherwise, 
for ¢ 1, 2.--- nm. Also 
(2.4) r the number of runs in 2, 
(2.5) ry» = the number of runs of length p in 2, 
(2.0) A the number of runs of length p or more in PR. 
evidently r : es = tpi. andr, = = Wes . 


1 amt a=] 
Os 





CT a a eT 
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If X and Y are stochastic variables, let E(Y) denote the mean of X, o(XY) 

denote the covariance of X and Y, and o°(X) denote the variance of X, if they 

exist. By the distribution function of X we shall mean a function f(z) such that 

P{X < x} = f(x), where the symbol P{ } denotes the probability of the re- 
lation in the brackets. 


3. Preliminary formulas. Let Y’ be a stochastic variable with any continuous 
distribution function f(y). Let Y = (y1, ye--+ , Yn) be a sequence of n inde- 
pendent observations on Y’. Since P{y; = yj} = 0, (@¢ ¥ 9; 1,7 = 1,2, --- , n), 
the distribution of runs up and down in Y is evidently the same as that in S. 
Now choose f(y) to be 


Sty) = 90, (y < 0), 
fly) = y, O<y<)), 
fy) = 1, (y = 1). 


1 1 vi 
1 
Ply < ye > Yiu} = | | i ( | dyi- ) iy. | dyiz: = 5. 
0 Vir1 0 3 


By symmetry 
E(a;) = P} (Yi-1 < Yi > Yi4i} + P| Yi-1 > Yi < Yin} = = ae ; 
(@ = 2,3,---,n— 1). 


lA 


Then 


Also E(a,) = 1, and E(x,) = 0. 
It will be necessary hereafter to evaluate expressions of the types 


(3.1) U = [~ sive lr Wi)" yy «++ dy, = Yor” 
0 _-_ > (kh + p)!’ 
and 
l 1 k 
‘ ‘ " (2 ) 
(3.2) J = l b cee E i dy, sa % dy» s 


From the fact that 


1 1 Un+1 r2 ( Pp 
, Up+1) 
| a / dy, ie dy p = | am | dv, oe dv, = P 
Up+1 y2 0 0 p: 


where v; = (1 — y;), G = 1, +--+, p + 1), it can easily be shown that 


k+p 


_4y\stl - (Vp) _ aie (Yp+1) 
- (k + s)\(p — s)! sites (k + p)! 


e—" r 


1 


I 
‘ M: 


(3.3) 


4 


xo __1\k+r (Vp41 
2. ( 1) pt+k —r)!r! 


o 


1 Yp+2 
We shall also need [ V dypii1 and “ r V dypyi dypi2. Now 
0 Jo 


k 
1 
3.4) Ni oe ; 
[ Fave. "2- (ptk—rt+1)!r! 
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Making use of the relation, 


. , 1 t l 
- ttm, am tet onions 
2 ( a (n—r)!r! —s n(n — t — 1)!t!’ ¢ <n), 
we have 
1 
e 5 A Yn = widens —. 
(3.5) I AY p41 (p +k + lyk! 
Similarly 
[ [Vaud 
3.6 P p+ oe = = 7 >\ 5 9° 
me £4 TYp+1 ors = CET 1plk! @rhk+ Dp + DIE 


4. Covariances of runs up and down. We first compute E(r,) and E(r,). 
We define the symbol 


P| ™ +”, —| = Pty > Yi < Yi+1 «, vig < Yi+tp > Yi+psi}. 


The value of the right member is independent of ? whenever it is defined (i.e. 
t~—-1>1li+p+i1<n). Now 


E(t») = P{-, +’, —} + P{+, —”, +} = 2P{-, +’, -} 
' : Yitp Yitl 1 9 
+ 3p+ 1 
-2/ | l | fay: o° AYisp+ — 2? ar 
0 Yyitp+1 40 0 bs Yi—1 Yi+p+ (p +3)! 
(¢ = 2, 3, ---,n — p — 1). 
E(tn) = 2P{+’, —} and E(ap,-p) = 2P{—, +7}. 


By symmetry E(2,1) = E(xp,.-p), the common value being 2 a2 _- Also 
(p + 2)! 
E(t») = 0, @ > n — p). 
Thus 
E(r,) = E (3 >) = 2E(ap) + (n — p — 2)E(zp:) 
t=1 
2 ‘ 3 a 
(4.1) «ee et! gt TS P . (p <n — 2). 


(p + 3)! (p + 3)! 


Besson [1], Kermack and McKendrick [5], and Wallis and Moore [6] gave the 
exact value, although Besson proved it only for special cases. R.A. Fisher [3] 
eave lin EG) 

It is clear that E(wyi) = E(apn—p), (@ = 2,°++,n — p), while E(w) = 
2P\{+"} = 2/(p — 1)!. We then have 


et! st te-! 


9 y) ") = . oo 
am i) (p +2)! 


(p S 2 — 1). 
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Setting p = 1 we have 
(4.3) E(r}) = E(r) = 3(2n — 1). 


Formula (4.3) was given by Bienaymé [2]. 
We now obtain o(rpr,). Let (a): — E(a@pi)) = zp:. Then 


a woe TE] 


= ie E(Zpizqi) + 22 E(Zqi2pj) + 22 E (Zp: 2qi). 


Forj > 7+ 4+ 3, x4: and x,; are independent and hence E(z,:2);) = 0. Omit- 
ting zero terms from (4.4) we have 


a(TpT,) = (2s E (xpi mai) + a E(xqitp;) + a E(Xpi Xqi) 


t<i<itaqt3 t<j<it+pt3 
(4.5) — (D0 E(@p)E(ea) + 26D) E(ea)E(2pi) 
t t< 1 <itet3 


+ DD _ EG) E Gai}. 


t<i<itpt 


Since rpityi = Spq(Xpi) = Spq%pi , We have for the first term of the right member 
of (4.5) 


(4.6) D Elenite) = ba E (ty); 


where the Kronecker delta 6,, = ¢ : cae 


Since x2,:.t,; = 0 fori <j < i+ q, the second term in the right member of 

(4.5) is 
n—p—-4q n—p— —q-2 
dX E(2XqiXp.itq) + - es, isan) + 7 E (Xqi Xpi+a+2) 
= {((n— p—q— 2E(radpirg) + (M — p — g — 3)E (Cai Lpi4g41) 

4.7) 
ge +o- - 4) E (xq Xp,i+a+2) 
+ E (xq Xp.q41) + E (tq Xp,q+2) + E(Xq1 Xp,c+3) 


+ Pisin Dial + Bhs n-axe-t — + Rs inatintileaaade. 


Now E(x oitpi¢g) = 2P{—, +’, —”, +} = 2A, where 


io) oe) LPL fated | 


-dYite* 


af 


+p+q YVitqrl 


*Yi+p+ati - 
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The expression within the square brackets is easily evaluated, and applying 
(3.6) to the result, we have 


1 1 
— (ptathpla (wot+at+2p+ Vl! 
sina 1 a | ; 
(pt+qt+2)pt(¢qt+1)! (pPtat3MPtDI@4t DV! 
Similarly, E(tgiXpigeus) = 2P{—, +°, —, +°, —}, and E(toitp.i4e42) = 


2Pi-,+%, -,-, +”, -—} + 2P{-, +%, -—, +, -—’, +}. The other terms 
in the right member of (4.7) are obtained in like manner. The right member of 
(4.7) is symmetric in p and q; hence the second and third terms of the right mem- 
ber of (4.5) are equal. 

We now consider the remaining terms in the right member of (4.5) for p > q; 
the result obtained also holds for p < g. We write them as 


(= qa n—q 


, > E( (tq)E (Zp. i— (p+2)) + > E(agiE(x p.i—(p4+ 1)) 
\i= p+3 i= p+2 
fee > E(2qi)E(tp.i-g—-o) + 2, E(%qi)E(tp.i-(p-e-n) 
i= p—¢qtl i= p—q 


n—p—l 


+-  D EewE Cn) + 2 E(x9)E (2p.i+1) 


n— p—(qt2) 


o me + Z. Blea)ECpsscer)) e 


= 


to 


( qt? | 


The (p + q + 5) sums in (4.8) comprise in all<(n — p)(p + q+ 5) — 2 Lk k> 


/ 


terms. Remembering that E(2r,.,-,)) = E(a tpt), (4.8) becomes 
— {In(p + q+ 5) — (P+ pg tg + Tp t+ 7q + 1G)JE(x,:)E (2p) 
+ [2p + AJE (rqi)E (ap) + [2g + AE (ra) E(ap;) + 2E (ta) E@p)}. 


Adding the right member of (4.6), twice the right member of (4.7), and (4.9), 
we have 


(4.9) 


a(r, 1) = 
{ p(ipt+qt+6)(¢ + 3¢4+ 1) 
>». * p(3q° + 20q° + 40g + 19) + (g + 9¢° + 299 + 26) 
(q + 3)'(p + 3)! 
Ee rer 5 _9 1 : 
(p+q+3)q + 2)!(+ 1)! (p+q+5)(¢ + 3)!(p+ 1)! 
> (p +9) + Up +4) + 23(p + 9) + 14 


+2 


(p+q+5)! 
+ + § p+ 3p +1| 


(p+qtlaip!' °" (p +3)! j 








ng 
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pg + 3q + 1) + pd + 9¢° +199 + 6) 
(4.10) saul 2 + pq + 9¢q° + 28¢° + 35q + 11) 
"| @ +3) + 3)!] + psqt + 20q + 409? + 299 + 10) 
| + (q° + 9q° + 27q¢° + 32q + 10) 
49 _ tat 2)(p — 9-1) pt+qat4 


eet eee or 
aiemaaaine o+qt+5q+3)!+)! 
3 (P+) + 10(p + g) + 20(p +g) + 16(p + 9) — 19 








(p+q+5)! 
txt. ....e tS oe=4 
(pt@atlatp! (p + 3)! 


J 


where 5,, is the Kronecker delta. Formula (4.10) is valid for p + q <n — 4. 
Itissymmetric in pand gq. Setting p = q we obtain 
9 2p’ + ‘15p* + 41p’ + 55p” + 48p + 26 

(p + 3)!(p + 3)! 





oa (rp) = 2n {-2 











2p + 9p + 12 _ , 4p + 18p" + 23p +7 
* Op + 3G + dp +3aIp+t 1)! (2p + 5)! 
1 p+3p+1\ 


iu). 4 OSs? 
p+ Date * (p+ f 


Git) 4 2.d93P" + 4p’ + Gop" + 90p" + 67p' + 42p + 10 


\ (p + 3)!(p + 3)! 
2p° + 1lp + 19p + 9° 


(2p + 3)(2p + 5)(p + 3)!(p + I! 


4. 9 16p' + 80p° + 116p" + 32p — 19 
(2p ad 5)! 


p - oti at 





om A eid wae OE: 
(2p + 1)p!p! (p + 3)! 


We next evaluate o(r,r,). Since w,;and w,; are independent for j > i+ q+ 2, 
we have, corresponding to (4.5), 


o(T pT) = 2s E(wyi wai) + YD Elway) + YY Ew wg) 


t<j<itet2 i<j<i+pt2 
(4.12) ~& E(wpi)E (wai) + eke E (wg) E (wp;) 
t<7<t+¢0t2 


+ D E(w,i)E(w,;)). 


t<i<titpt2 
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Let G = Max (p,q). Then w,v,i = we; and we have for the first term of the 
right member of (4.12) 


(4.13) YS E(wpivy) = E(t). 


The second term in the right member of (4.12) may be written 
(n =— 2-2 = L)E (weitlp,i+¢) + (n =— = 2 = 2)E (WaiW’p,i+a+1) 
+ E(wawp.qsi) + E (Wap ,942). 


Now E(wgitly,i+e) = 2P{—, +°, —7}, E(weitlpiten) = 2P{—, +", —, +7} + 

2P{—, +°**, —”}, and the other terms are obtained similarly. The third term 

in the right member of (4.12) will be equal to (4.14) with p and q interchanged. | 
The remaining terms in the right member of (4.12) become 


(4.14) 


— {np + q+ 3) — (p+ pg tg + 4p t+ 4q + S)JE(w,)E(w,,) 
+ [p + IE(w)E(wn) + la + YE(Wwa)E(,;) + EWwa)E(wn)} 
We can now write the formula for o(r,r,), valid for p + q < n — 2, 


p(2q + 2) + p(2q’ + 8q + 5) + (2 + 1)(q + 2) 
(q + 2)'(p + 2)! 


(4.15) 


o(r, r,) = 2n \7 


+ 2 _ @+ VG +2) + (+ Ip + 2) 
| pt+qt2 (G + 1) 


@+a+3! G+DY 


494P (2q + 2) + p'(2¢ + 8q +5) +: + p(2q +89 +69—2) + (2q° + 5q° — 2q — 6) 





\ (q + 2)'(p + 2)! 
_9 pt (p+q+2)(p + I(p+2)+ @+1@ + 2)) 
(p+q+ 1)q!p! (p+ q+ 3)(q + 2)'(p + 2)! 
pg Pt t+3o+q+1_ EF+E-1\ 
(p +q +3)! (G+ 2)! )’ 
where G = Max (p,q). Setting p = q we obtain 
) 1 
2(n) = 2 2 (P -_= + 4p +1 onal 
o (>) n{-2 t+ 2p +2! +7 @p+ plo! 
— 2 * — — 4 a>. p +1\ 
4.17) - + 3)(p + 2)!p! (2p + 3)! (p+2)! 
old 
(p + 1)°(3p" + A » §) Pp 
£13 = <a 
" (p + 2)\(p + 2)! (2p + 1)p!p! 
44 oti __ gn ++! £ +2- 








(2p + 3)(p + 2)!p! (2p + 3)! (p + 2)! J 
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the Setting p = 1, we have 
3%, 2. lén— 2 
(4.18) a(n) = o(r) = 0 
The value of o’(r) was given by Bienaymé [2]. 
Finally, we evaluate 


a(r, r,) = = 2X E(x, yi Wai) + Zz x E(w: Spi) + 2 a E(x, i Wai) 


i<j<it+qt+2 t<j<itpr3 
et (4.19) - Iu E(xp)E(wy) + Do 2, E(w,)E(xp;) 
t<j<itgt 
+ t + x » _ Er) Ea). 
: F t<j<itpt 
rm fa a 
ed. f Let the symbol 7; ; = 10, < 4 . Then 2p; Woi = tpg Xpi , And 
pi) (4.20) 2d E(XpiWgi) = ql E(rp)). 


lA 


The remaining terms of (4.19) introduce no new difficulties, and for p + gq 
n — 3 we obtain 
( p'(2q + 2) + p'(2q° + 13q + 12) 
ts i ie} + p(6q° + 22g + 23) + (2q° + 6g + 15) 
o(Tp%,) = 2n - 
(p + 3)!(q + 2)! 


+ : ~ Fm Ra 
(o+qt+ pla! (p»+qt 2)(p + 1)Mq + 1)! 
(p — q+ 1)@ + 2) (p + 2)(p + 3) + @ + IDG + 2) 
(p + 9 + 3)(p + 2)! + 2)! ret 4 \(p + 3)a + 2)! 
6) _g@+a'+5@+g4+5, ae p + 3p + 1\ 


(p+q+4)! (p+3)! ; 
p (2q + 2) + p'(2q° + 13q + 12) 
ol | we p (2q° + 13q° + 26q + 24) 
“\(p + 3)"@ + " p(6q° + 2247 + 19¢ + 27) 
+ (29° + 6q° + 10q + 25) 
wit p+q _P+p-F +2 
(p+aqt+ 1)pla! (p+q4+2)(p+1)'q4+ 1)! 


_ pt 2)\(p + 2)q + 3) — 1] — a¢ + Iq 4+ 2) 
(p + q + 3)(p + 2)'(q + 2)! 
_@+a+ 3yl(p + 2)(p + 3) + @ + D@ + 2)I 
(p +q+ 4)(p + 3)!@ + 2)! 
op+9 +6o+ 9 +80+9—-1 p + 3p — p— 4\ 
p+q+4)! ~ eran f’ 
} Where pq is defined as in (4.20). 


(4.21) 


> 


) 
! 
i 
i 
: 
9 
| 
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5. The use of runs up and down in tests of significance. Certain miscon- 
ceptions about the application of runs up and down have appeared in the litera- 
ture, and it is the purpose of this section to clarify them. 

Since E(rz), o°(rp), E(r) and o°(r) are all of the order n, it follows that rp/t 
converges stochastically to 


= lim E(t») 


r a 
” ems 


S 






‘ 


: E(r, 
Ne = lim BG 





From (4.1) and (4.2) we have 


M1 = 
eo = 


A3 = 


280 



















_ Erp) 
Ron _ E(r) . 





Some writers say that A,, or A, is “the probability of a run of length p.” If 
the stochastic process consists in obtaining a sequence from among the n! se- 
quences S, each of which has the probability (n!)’, then the phrase “the prob- 
ability of a run of length p” has no meaning. One can speak of the probability 
of at least one run of length p (i.e., that r, > 0), of the probability of no run of 
length p (7, = 0), of the probability that the first or fifth run (if there are five 
runs) in the sequence S be of length p, etc. It is possible to give different sto- 
chastic processes in which “the probability of a run of length p” will have 
meaning and be A,,, or A,. Consider, for example, the totality of all the runs 
in the n! sequences S. ‘There are n!E(r) of them, and among these there are 
nt!E(r>) runs of length p. Now let the stochastic process consist in drawing a 
run from the totality of all these runs, each of which is to have the same prob- 
ability, which is therefore [n!Z(r)]"'. Then the probability of drawing a run of 
length pis Ap, . It is difficult to see how this stochastic process can have rele- 
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vance to most of the problems of quality control and economic time series where 
runs up and down are now used. 

Some writers on quality control and economic time series recommend that 
statistical control or randomness be tested by use of di, --- , dp1, dp , where 


d; = 7; — E(r), @@ = 1,2,---,(@p—1)), 
d, =r, — E(r,). 

The availability of the covariance matrix M of d,, --- , d,-1, d,, , which we have 
obtained in this paper, will assist in the construction of such tests. Also of help 
will be a result recently announced by one of us [7], the early publication of which 
jis expected. This result states that in the limit with n the joint probability 
density function of di, ---,d 1, d,, is Ke *®, where K is a constant and Q 
is a quadratic form in d; , --~ , dp-1 , d, whose matrix is the inverse of the matrix 
M. It follows immediately that Q has in the limit the x° distribution with p 
degrees of freedom. 

We wish now to make a few remarks about the tests of significance, based on 
runs up and down, which are used by some contemporary writers. A descrip- 
tion of their method can perhaps be best given by an example. With n = 100 
and p = 5, say, suppose the observed values are: 

Observed Values 
Ty 30 
rg = 10 
3 4 
%~ = 3 


/ 
mn = 3 


Total, r = 50 
These writers then say that the expected values are: 


Expected Values according to some writers 
E(r,) = ry = 50 (.6250) = 31.25 
E(re) = rhe = 50 (.2750) = 13.75 
E(r3) = rds = 50 (.07917) 3.96 
E(rs) rks = 50 (.01726) 0.86 
E(r3) = rds = 50 (00357) = 0.18 

50.00 


The correct expected values are given by (4.1) and (4.2) and are: 


Correct Expected Values 
E(r,) = 41.75 
E(r2) = 18.10 
E(r3) = 5.15 
E(r4) = 1.11 
E(r;) = 0.22 

66.33 
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It should be noted that: 


(a) A consequence of the incorrect method of obtaining ‘‘expected values” 
is that, since 


E(r) = E(n) + E(m) + E(rs) + E(rs) + E(x), 


it implies that the expected number of runs of all lengths is equal to the observed 
number! This is obviously erroneous. In fact it follows from (4.18) and the 
results announced in [7] that 7 — E(r) is in the probability sense of order ~/n. 

(b) By using the incorrect expected values for comparison with the observed 
values one loses the valuable information furnished by r — E(r). If this is large 
(in terms of its standard deviation) it is plausible to question whether statistical 
control or randomness exists. 


6. Summary. Let S = (lu,--:,4n2) be a random permutation of the n 
unequal numbers a, --- , a, , and let R be the sequence of signs (-++ or —) 
of the differences h;.; — h; (¢ = 1,---,n— 1). Itis assumed that each of the 


n! sequences S is equally probable. A sequence of p successive + (—) signs 
not immediately preceded or followed by a + (—) sign is called a run up (down) 
of length p. Let 7, and r, be the number of runs up and down in RP of lengths p 
and p or more respectively. In this paper the exact values of o(r,r,), (see 
formula (4.10)); o°(r,), (formula (4.11)); o(7,r,), (formula (4.16)); 0°(7',), (for- 
mula (4.17)); and o(r,r,), (formula (4.21)) are derived. A few numerical 
values are: 


Mr) = 305n — 347 in) = 51106n — 73859 
Te _e:ClmtlUC i‘! 453600” 
2(7") _ 1l6n — 29 2(74) a din — 43 o(r,) a 214967 eed 51269 
“en 90.” -e 720.” ' 453600.” 
19” 11 5n — 3 ' 
(rin) = — alti) =, o(rirt) = 
_ 4in — 99 windy = _ 23n + 135 on 117n — 79 
630” = 1260 ’ = 720 |” 
/ 363n — 817 : 346n -- 49019 
a 363n — 817 il sia _ 18346n -- 4901 


5040’ 453600 


rn . ’ ‘ 4 / ss 5 

The values of E(r,), (formyla (4.1)); and E(r,), (formula (4.2)) are also 
given. Certain misconceptions about the applications of runs up and down 
are discussed. 
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ON THE MEASURE OF A RANDOM SET 


By H. E. Rospins 
Post Graduate School, U. S. Naval Academy 


1. Introduction. ‘The following is perhaps the simplest non-trivial example 
of the type of problem to be considered in this paper. On the real number axis 
let N points x; (¢ = 1, 2,--:,N) be chosen independently and by the same 
random process, so that the probability that x; shall lie to the left of any point 
x is a given function of z, 


(1) o(x) = Pr (a; < 2). 


With the points x; as centers, N unit intervals are drawn. Let X denote the 
set-theoretical sum of the N intervals, and let u(X) denote the linear measure 
of X. Then u(X) will be a chance variable whose values may range from 1 
to N, and whose probability distribution is completely determined by a(z). 
Let 7(u) denote the probability that u(X) be less than u. Then by definition, 
the expected value of u(X) is 


(2) E(u(X)) = I udr(u), 


where 
(3) t(u) = Pr (u(X) < wu). 


The problem is to transform the expression for E(u(X)) so that its value may be 
computed in terms of the given function o(2). 
In order to do this, we observe that, since the x; are independent, 


(4) ee | ae | deka) ++ dokesd, 


C(u) 


where the domain of integration C(u) consists of all points (a1, +--+ , xy) in 
Euclidean N-dimensional space such that the linear measure of the set-theoretical 
sum of N unit intervals with centers at the points x; is less than uv. Here, how- 
ever, a difficulty arises. Due to the possible overlapping of the intervals, the 
geometrical description of the domain C(u) is such as to make the explicit evalua- 
tion of the integral (4) a complicated matter. 

The difficulty is even more serious in the analogous problem where instead of 
N unit intervals on the line we have N unit circles in the plane, with a given 
probability distribution for their centers (x; , y;). Again we seek the expected 
value of the measure of the set-theoretical sum of the N circles. The correspond- 
ing domain C(w) in 2N-dimensional space will now be very complicated. 

It is the object of this paper to show how, in such cases as these, the expected 
value of u(X) may be found without first finding the distribution function 7(1). 

70 
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In fact, the theorem to be stated in (15) will in many important cases yield a 
comparatively simple formula for E(u(X)). 


2. Expected value of »(X). In order to state the problem in full generality, 
let us suppose that X is a random Lebesgue measurable subset of Euclidean n 
dimensional space E,,. By this we shall mean that in the space 7’ of all possible 
values of X there is defined a probability measure p(X) so that for every p- 
measurable subset S of 7’, the probability that X shall belong to S is given by 
the Lebesgue-Stieltjes integral 


(5) Pr (X ¢ S) = ‘ Cs(X) dp(X), 


where the integrana is the characteristic function of S, 


; (1 for XeS 
(6) Cs(X) = } 
\O0 for Xé¢S. 


In practice, the set X will be a function of a finite number of real parameters 
(e.g., the coordinates of the centers of the intervals or circles considered in the 
Introduction), X¥ = X(a,,---:,a,) = X(@). There will be given a probability 
measure v(a) in the parameter space EF, , so that a@ will be a vector random 
variable in the ordinary sense. If A is any v-measurable subset of FL, , then by 
definition, 


(7) Pr(weA) = | Cala) dv(a). 


Now for the set S’ consisting of all X such that X = X(qa) for a in A, we define 
p(S’) = v(A). Thus a p-measure is defined in the space 7 of X, which is the 
general situation considered in the preceding paragraph. 

Returning to the general case described in the first paragraph of this section, 
we shall now prove the main theorem of this paper. To this end we define, for 
every point x of EH, and every set X of 7’, the function 


1 for rweX 


(0 for x@X. 


(8) g(x, X) = 


Moreover, for every x in /,, we let S(x) denote the set of all XY in 7 which contain 
x. Then for every x in E, we have from (6), 


(9) g(x, X) = Cscx)(X). 
Let us denote the Lebesgue measure in E, of the set X by u(X). Assuming 


that the function g(x, X) is a up-measurable function of the pair (x, X) in the 
product space’ of E,, with T, it follows from Fubini’s theorem’ that 


(10) [ ae, X) due, X) = | fale, X) do(X) aula), 
EnXT En 7 


‘See S. Saks, Theory of the Integral, G. E. Stechert, N. Y., 1937, pp. 86, 87. 
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From (5) and (9) it follows that 

(11) [ gia, X)GAX) = Pr (Xo 8@)) = Pe @ eX). 
Again by Fubini’s theorem we have 


(12) [  alx, X) duole, X) = | [ g(e, X) u(x) dp(X). 
EnXT T En 
But from (8), 


(13) [oe duo) = f du(e) = wd, 


“7 


Now from (10), (11), (12), and (13) we have 

(14) [ Pr (we X) du(x) = [ u(X) dp(X). 

But the latter integral is equal to H(u(X)). Hence we have the relation 
(15) B(u(X)) = [Pr (we X) dul). 


This is our fundamental result. We may state it as a 

THEOREM: Let X be a random Lebesgue measurable subset of E,, , with measure 
u(X). For any point x of E,, let p(x) = Pr (we X). Then, assuming that the 
function g(x, X) defined by (8) is a measurable function of the pair (x, X), the ex- 
pected value of the measure of X will be given by the Lebesgue integral of the function 
p(x) over EF, . 


3. Higher moments of u(X). We may generalize the result (15) to obtain 
similar expressions for the higher moments of »(X). For the second moment 


we have the expression 


(16) E(w(X)) = [ u?(X) dp(X). 


Now from (13), 


u(X) = w(X)-y(X)-= f g(x, X) au(x): [ g(y, X) duly) 


(17) 
i [ [ g(x, X)-g(y, X) du(x) du(y). 


Let 


; ia aie i -. = Lif X contains both x and y 
(18) g(t, wy X) = g@, X)-9Y X) _ 6 otherwise. 
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Then from (16), (17), and (18), we have as before by Fubini’s theorem, 


Bux) = [ff ates a X) dua) duly) do(X) 
(19) eg 


= I. I [ g(x, y, X) dp(X) du(x) duly). 


But from (5) and (18) it follows that 
(20) [ o0e, y, X) do(X) = Pr (we X and y eX), 
. . 


The latter probability may be denoted by p(z, y). This function will be defined 
over the Cartesian product, E2, , of E, with itself. Let u(x, y) denote Lebesgue 
measure in E2,. Then from (19) we have 


(21) E(u'(X)) = [ p(x, y) du(z, y), 
where 
(22) p(x, y) = Pr (we X and yeX). 


The formula for the mth moment of u(X) will clearly be 


(23) Exp (u"(X)) = i P(t, X22, +**, Lm) du(X1, T2, +++, Lm), 


E mn 


where u(21, %,°°* , Um) denotes Lebesgue measure in F,,, and where 
(24) P(t1, %2,°** , Am) = Pr (a1 € X and w2€X --- and z,€X). 


In the next section we shall apply formulas (15) and (21) to a specific problem. 


4. Let a, p, B be given positive numbers such that (B + a)p < aanda < B. 
We shall define the random linear point set X as follows. N intervals, each of 
length a, are chosen independently on the number axis. The probability 
density function for the center of the 7th interval will be assumed to be constant 
and equal to p/a in the interval —a/2 < x < B + (a/2); it may be arbitrary 
outside this interval. The set X is now defined as the intersection of the fixed 
interval J: 0 < x < B with the variable set-theoretical sum of the N intervals. 
The hypothesis of (15) is clearly satisfied. The probability that any point x 
in the interval J shall be contained in the 7th interval of length a is clearly 
(p/aja = p. From this it follows that 


1—(1—p)*for0<2<B 


(25) Pr («& eX) = p(x) = 


0 elsewhere. 
From (15) it follows that 


(26) E(u(X)) = | ple) de = BO = (1 = p)"). 
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(The same formula holds in the case where the N intervals of length a are re- 
placed by N circles of area a and I by a plane domain of area B, provided that 
for every point of the domain the probability of being contained in the 7th circle 
is equal to a constant p. A similar remark holds for spheres in space.) 
To evaluate E(u’(X)) in the linear case we make use of the identity 
(27) Pr (A and B) = Pr (A) + Pr (B) + Pr (neither A nor B) — 1, 
which holds for any two events A and B. It follows from (27) and (25) that if 
x and y are any two points of J, then 
p(x, y) = Pr (we X and ye X) 
(28) Pr (x eX) + Pr (ye X) + Pr (we X and y¢X) — 1 
= 1 — 2(11 — p)* + Pr (ve X and ye X). 
Let 
(29) h(a, y) Pr (« ¢X and y ¢X). 
Then 
(1 — (p/a)2a}” = (1 — 2p)”, for |y—2z|>a 


a 


4 N 
(30) h(x, y) = 4{1 — (p/a)(a + ly — x}))* = ( — op — Ply: 2!) 


for |y—a|<a. 
Now from (21), (28), and (29) we have 


B B 
E(w(X)) = | | p(x, y) dy dx 
0 0 


B B 
= | [ [1 — 211 — p)* + A(z, y)| dy dx 
0 0 


B B 
= Bil — 211 — p)*) + 2 | | h(x, y) dy dx. 
0 z 


When the latter integral is evaluated the result is 
E(w(X)) = Bl — 2(1 — p)*] + (B — a)*(1 — 2p)* 
4. 2aB( — p)*** _ 2a(B — a)(1 — 2p)*" 
(N + 1)p (N + 1)p 
2a° N+2 N+2 
—Wwenw + 2p lll "~~ a~2a's 
Combining this with (26), we find for the variance of u(X) the expression 
a = E(w(X)) — [E(u(X))F | 
N+ 
(33) = (B—a)(1 — 2p)” — Bl — py” + WES 
__ 2a(B — a)(1 — 2p)*"" 2a” 


— on ae inl N+2 
(N + 1)p (WE iw + appl — PG ep) 





ON THE DISTRIBUTION OF THE RADIAL “TANDARD DEVIATION 
By Franx E. Grusss’ 
Aberdeen Proving Ground 


1. Introduction. Of interest in the field of ballistics is a measure of the 
accuracy of bullets. In acceptance tests of small arms ammunition lots, for 
example, a sample of rounds from each lot is fired from a fixed rifle at a vertical 
target placed a specified distance from the rifle. The accuracy of the bullets 
is taken to be some measure of the scattering (or lack of scattering) of the bullet 
holes on the target. The purpose of such a test would be to determine whether 
or not the lot under consideration differs significantly in accuracy from (a) 
standard values or (b) its predecessors. 

One useful measure of accuracy is the radial standard deviation which is 
defined by the relation 


(1) z-4/3 2, - — a + » le an _ , 


where x; and y; are respectively the abscissa and ordinate of any point measured 
from an arbitrary origin and N is the sample size. 

It will be the purpose of the present discussion to call attention to a series 
expansion for the distribution of the statistic Z in samples of NV assuming that 
the distribution of all rounds of the lot on the target follow the bivariate normal 
population law 


(2) x = e 2%] 203 (x and y statistically independent) 


where o; and a3 are the parent variances of x and y respectively. In the above 
probability density function, the population means are taken to be zero since 
the statistic Z is quite independent of the origin selected. 
© . r72 ry . : . 2 ] x =\2 

2. Moment generating function of Z°. The distribution of sj = V U(x; — £) 

in samples of N from a normal population is given by the well-known law, 
N 
ash (Ne\KY OME, 

3 dF (s;) = ——_ | —; e€ 2? ds; s; > 0. 
(3) (si) r(“>) Qo1 i ’ fe 


9 


— 


The moment generating function of sj may be found (in a neighborhood of 
= 0) by straightforward integration: 


« 2,\ —3(N—1) 
(4) M(t) = E(e"') = [ e*'' dF(s}) = {! — si 
0 iV 


‘haat Ordn: ance Department, Ballistic Research Laboratory, Aberdeen Proving 
Ground, Md. 
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Likewise, for s: = - =(yi — 9)’, we have 
\ Y 


; . a= 

M,:(t) = _- — ; 

(5) T43(t) , V \ 

Now M22(t) = Mez4.3(t) = Efe'i't?')} = E(el')-E(e?') since x and y are in- 
dependent. Thus, 


2 ,\-}(N-1) 2 4) —}(N—1) 
Malt) = Ma(t)-M.a(!) ={1- : ait i ~ aaah 


3. Distribution function of Z’. Making use of the Fourier theorem, we have 


3(N—1) (N-D) 
(6) f(2) = — af i! os ae {1 - et c"-. 


at all points of continuity of f(Z’). 

The discussion Ww ill be divided preferably into the two cases: Case I: ¢} = 03, 
and Case I: a1 x a2 : 
Casel: 65 = or =o. 

In this case the distribution of Z’ reduces to 


(N-D 
(7) f(Z’) = = . af {1 - 2a" rh g~'’ & 


i i if . : . ° > 9 4 ix 
It will simplify the algebra to find first the distribution of w= = and then 
40° 
that of Z°. Since Met) = {1 — 2} —(N a 


(8) fiw) = . it-—ar? e"e 
2m Jw 
This integral may be evaluated easily by the calculus of residues since the inte- 
grand has only a single pole of order (N — 1) at t = —7. We will, however, 
make use of the following method. 
Put —v = w — iu’t; then 


Hae) 1 —u2+ioo i" - a2 dy 


2m J-ut—ico uw tu? 
(9) u2 9 


= 2, N—2 —u2—io 
—e“ (u si ~(- 
= — (w) [ e "(—v) *” dv. 


271 ur+tico 
The integral in the last expression is Hankel’s integral [1]; namely, 


1 


“-1) dt,  R(Z)>0, a> 0. 


Therefore fw) = = : 


—u2;, 2,N—2 
rv—i? “) » 
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N 


9 2 NzZ2 7 72\ N- 
20? ~o9F (72 


N-—2 
MZ?) = —<o NZ gt. te hi 
dF (Z°) rw =) dZ’; from which 


*(Ge) Nz2 
(11) dF(Z) = y ye Be? Z2N-8 7 


(Note that f(Z) is continuous over 0 < Z < ~.) 

This expected result has been obtained by Reno and Mowshowitz [2] who 
employed an extension of the famous Helmert distribution. 

Actually, the result is an obvious one and may be ar gued as follows: Ns}/o" 
is distributed as x” with N — 1 degrees of freedom and N ~ is also distributed 


as x with N — 1 degrees of freedom. Hence, the statistic * » (Si + s>) is, from 


the additive property of x’, distributed like x’ with 2N — 2 ions of freedom. 
We now turn to the general 
Case II: 0; ¥ 03 
No generality will be lost by taking oj < o:. In fact, the present attack will 
hold with obvious modifications provided oj < 2o3. 
Recall that 


9 4(N-—1) 9 -. -4(N-1) ) 
a2) f(@) at Lf ws mail 7" ait eet ay 


NV 


at all continuity points of f(Z”). 
In a manner analogous to that employed by Hsu [3], we replace 


¢ - a by (1 - iN ~ eS. 
A ai A 1 — 2ojit/N) 


Further, since 
1 — oi/oa_ 
1 — 2Qorit/N| 


we may write 


(N- 
203 it —}(N—1) o 4(N—1) 207 it —}(N—1) © I (* Q + r) 
7 =“\a) Uy 24 7N = 1 
. r( ) ro + 1) 
2 
i ay 
03) 
nae 
N 
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: | 201 it\ OY igs 
13) % =: nati suageiaiaieiaiiieae eke eng tine 
: | om a 


; ; N —- , 
with the understanding that 7g (* a l for r = 0. 


We note that the moduli of the terms of the above series are for all ¢ not greater 
than the corresponding terms of the following convergent series of positive terms: 


Therefore, uniform convergence over (— «, ~) is established. To show that 
we may integrate over the infinite interval term by term, we observe that 


| S(t) — S,(t)| < e¢(t) for all ¢ and all large r, where 


a 202 it\ °°" 
y= eq —* ~ oa 
S(t) { N } 1 N ' 


S,(t) = the sum of the first 7 + 1 terms of the series, and the function ¢(t) = 
2 +, |-2 
1— = which is integrable over (— x, ~). That is, S,(t) converges to 


S(t) uniformly relative to g(t). Hence, 


N 


2\ 3(N—1) 
1 
2 (z:) =~ (1 ~ 79 0 202i) _. 
(14) f(Z*) = “2 ____  _\__8 y/ {1 - — } et?" dt. 


2r pa (* —]1 
rB | —~ r 
2 ? 


We have already carried out the integration under Case I with the exception 
that (N — 1) should now be replaced by (V + r — 1). The distribution of Z° 
will then be given by 

N. 
261 


eee 
rc 


_Nz? NZ2\ N+1-2 , 
-e 20% Ga) d(Z). 


a0} 
2 The author is indebted to Prof. E. J. MeShane for this definition which is due to Prof. 


2 oo 
E.H. Moore. It may be shown easily that lim | S,(t) dt = | lim S,(t) dt. 


r—c J eo 7700 
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Finally, the distribution function of Z is 


2\r N Nt+r—1 
01 se “ 
| . — (XS ) rV+r—-1)° |“ : 
9 ? 


We remark that the above series expansion holds, of course, for N odd or even. 
In case N is odd it may be shown that the distribution function may be expressed 
as a finite series of Incomplete Gamma Functions.* However, the finite expan- 
sion for N odd appears to offer no marked advantage since for computational 
purposes the infinite series expansion converges quite rapidly (N either odd or 
even) and may be put into a convenient form given below. 


4, Computational form for the distribution function. In deciding whether 
or not an observed value of Z is significant and likewise in control chart proce- 
dure, one is interested in the percentage points of f(Z). For example, it may be 
desired to find the value of k such that P{Z < ky/o? + o3} = .995, say, for 
various sample sizes N. In this connection it will be convenient to work with 
the distribution of Z’, for P{Z < ky/o? + o3} = P{Z < kK (oi + o3)} also. 
Now, 


k?(¢2+02) - 
PI? < Ro? + -3)} = I dF (2) 
0 


a & 1 ') r(N +r —1) 


ss r 
Oj 
(zi) ) « (1 - “:) 
_(1 > 3 


o3 _ 
9 ’ 


K2(oito3)  NZ2 (NN Z2\Nir-e 
| e ( :) d(Z), 
0 201 


since we may integrate the series term by term over the entire range of Z° or 
any part of it [5]. In the terminology of Karl Pearson’s Incomplete Gamma 
Function [3], 


(19) I(u, p) = . : i ev’ dv, 
I'(p + 1) Jo 
we may write the above series in the form 
P{Z’ < Ki + 03)} 


s. 


o 4(N-1) ( = “) Nk (1 . *:) \ 
- (2) > = “7 N+r—-2 
o 


I ' . 
r=0 rp (* > ; r) 2\/N + r—] j 


3 Prof. C. C. Craig kindly pointed out this fact to the author. 


2 
2 
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It is indeed convenient and enlightening that the result is a function of the 
ratio, o}/o2 , and not oj and/or o explicitly. 

Hence, for a given sample size and ratio of 1/02, we may find k by inverse 
interpolation such that P{Z < ky/o? + o3} = a, any desired level of probability. 


5. Moments and percentage points for Case I. For the case met many times 
in practice, ie. ¢1 = 03 = a’, We will give a table of the mean and standard devia- 
tion and also several pr shebility levels which are obtainable directly from the 
percentage points of the x” distribution [6]. 

From (11), we have 


N N-1 
(#) 

ee) ae eH 2N+k-3 
(21) E(Z’) Pv 1) € Z dZ 


_TrW-1+ 1) (2 ) 
rivN—1)  \W/)° 
Thus, 
_ TW —- 1/2 
(22) Ki:z = Ne a i z G, 


(23) jaw eo y 


and 
~§ 2fy_,—[PW —1/2)7 
wna wh l r(V = 1) The 


In the table below, the mean and standard deviation are given as a multiple 
of V 2¢, and k.9; , for example, is that value of k such that P{Z < ky/2e} = .95. 
TABLE I 


Perce Dit 
Mean Standard ercentage Points 
: Deviation | Cate ae 


k.005 | Kos k95 kos 


6267 3276 | .0501 .1602 | 1.2235 6276 
7675 2786 1857 3442 2575 .5738 
.8308 2443 2906 4521 2546 5226 
8670 .2198 3667 5227 2453 4817 
8904 2014 4239 5730 2351 4488 
.9068 1869 * .4686 6110 2255 4218 
9189 1752 5046 6408 .2167 .3991 
.9282 1653 5345 .6651 2087 .3798 
.9356 .1569 .5597 6852 2014 .3630 
9416 1498 5813 7023 1949 .3483 
.9466 1434 6001 7170 .1889 3353 
.9508 .1378 6166 .7298 1835 3237 
9544 .1330 6313 7411 .1784 .3132 
9575 1285 6445 7512 .1738 .3038 


> or > W HO 


NI 
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A MATRIX PRESENTATION OF LEAST SQUARES AND CORRE- 
LATION THEORY WITH MATRIX JUSTIFICATION OF 
IMPROVED METHODS OF SOLUTION 


By Pau. 8. DwyEer 
University of Michigan 

1. Introduction and summary. It is the aim of this paper to exhibit, by using 
elementary matrix theory, the basic concepts of least squares and correlation 
theory, the solution of the normal equations, and the presentation and justifica- 
tion of recently developed and newly proposed techniques into a single, com- 
pact, and short presentation. We shall be mainly concerned with the following 
topics: 

a. Basic least squares theory including derivation of normal equations, the 
theoretical solution of these equations (regression coefficients), the standard 
errors of these solutions, and the standard error of estimate. 

b. The more specific theory (correlation theory) resulting from applying the 
general least squares results to the standardized distributions. 

ec. A matrix presentation of the Doolittle solution. 

d. A simple matrix justification of methods, previously presented, for getting 
least squares and multiple correlation constants from the entries of an abbre- 
viated Doolittle solution. 

e. A presentation of a more general theory which the matrix presentation 
reveals. . 

f. The outline of a “square root”? method as an alternative to theDoolittle 
method. 

The reader should be familiar with elementary matrix theory such as that out- 
lined on pages 1-57 of Aitken’s book [1]. 

No previous knowledge of the Doolittle technique is demanded although a 
familiarity with the notation and contents of two earlier papers [2], [3] is advised, 
particularly for those who are interested in the computational aspects. 

The presentation here is theoretical and is not concerned with such compu- 
tational topics as the number of decimal places required, etc. With referenee 
to the number of places, the reader is referred to the recent paper of Professor 
Hotelling [4]. 


2. Notation. Let (x; | with <i < Nand 1 <j < nbe then by N matrix 
of observed variates of n “predicting variables” for N individuals with 7 indicat- 
ing the individual and j the variable. Let [y;] be the one by N column matrix 
of the observed variates of the “predicted” variable. Let the matrices of devia- 
tions from the variable means be indicated by [x;;] = X and [y;] = Y. Then by 
the least squares hypothesis we are to find numbers by1.... , Dy... , +** , Dyn. 


such that 


Qe; = Yi — (aby... + Liady.... 4 +++ + Vindyn-..-), 
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shall have a minimum variation (standard deviation). We then denote the 
by:.... by the one by n column matrix B and the e; by the one by N column ma- 
trix E and have 
(1) E = Y — XB, 
as the basic matrix equation. 

It may be noted further that the fitted values of y; are given by the one by N 
matrix product XB = Y. Using this notation (1) appears as 


(1’) E=Y-Y. 


3. Basic least squares theory. 
a. Sum of squares of residuals. ‘The condition for minimum variation in this 
situation (variates measured from means) is equivalent to the condition for 


minimum sum of squares of residuals. In matrix notation this sum of the 
squares of the residuals can be written 


(2) E'E with EF = Y — XB = Y — Y, and E’ the transpose of £. 


b. The normal equations. Differentiating (2) with respect to B’ we find the 
necessary condition to be 


(3) X'E = 0. 

This matrix equation gives the normal equations in implicit form. More ex- 
plicitly by (1) we have X’(Y — XB) = 0 so 
(4) X'XB = X’Y. 


The reader should immediately recognize that (4) is the matrix equivalent of 
the usual statement of the normal equations where deviations from the means 
are used. It should be noted also that (3) and (4) can be written in the form 


(5) X'Y = X’Y from whence at once Y’Y = Y’Y. 


c. Solution of normal equations. The theoretical solution of (4) is accom- 
plished at once and results in 


(6) B= (X’X)"X’Y = (X’X) 'X’Y. 


d. Standard deviation of residuals. Tie standard deviation of residuals is 
VE'E/N. 
In order to evaluate this we note that 
(7) Y’E = B’X’'E = 0, and Y’Y = Y’Y, 
Thus 


(8) B'E = (Y — Y)'E = Y'E = Y'(Y — XB) = Y'Y — Y’XB, 
and 


(9) Y’XB = Y'Y = Y'Y = Y’Y. 
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Since Y’Y = Xy’, we have 
we Y’XB 
(10) K’E = xy (1 — Sy ) , 


so that, dividing by N and taking the square root 


Tiv 
(11) Se = 8, 4/ jp ae 
“y 


If the relation between the estimated standard deviations in the population is 
desired then divide each side of (10) by the number of degrees of freedom and get 


Te 
(12) Oe = Oy 4/3 ~ ae 


Alternative formulas to (11) and (12) are obtained by replacing Y’XB by its 
equivalent expressions in (9). 

e. Formulas for multiple correlation coefficient. It is to be noted that the 
numerical quantity Y’XB/Zy’ plays an important role in measuring the ratio 
o./o,. It is customary to use this quantity as the definition of the square of 
the multiple correlation coefficient so we have 


YWXB _ BYX'XB _ xr’ xy *x'Y me et 


zy? zy” zy" 


(13) f-2,---2, = 


f. Formulas for correlation coefficient. When n = 
X'Y = SXY, B = band (13) gives 


. LS 2 ‘ yz . 
(14) Nyx = 4/32! = b / — ( = b =) = . ty = "7 7 
ay" oy" Ty Vie ry? Fy 


Many of the above developments can be duplicated, without formal use of ma- 
trix theory, by judicious use of symbolism and substitution. See for example 
the presentations of Kirkham [5], Bacon [6], and Guttman [7]. 

q. Errors of regression coefficients. If Bo is an approximation to B such that 
By + AB = B then (6) can be written 


By + AB = (X'X)"X'Y 
and 
(15) AB = (X'X)'X"(Y — XB»). 


This formula can be used in finding corrections AB necessary to change any 
proposed trial solution, Bo , into a correct solution. It could also be used in 
extending the accuracy of a solution after an approximation had been secured 
to a specific number of places. It has greater utility however in another problem. 
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We suppose that the predicting variables, the x’s, contain no errors but that 
there are errors in the observed values of y. Let the hypothetical observed 
values of y be indicated by Y and the recorded observed values of y by Yo. 
Let the values of Bo be the regression coefficients obtained by using the recorded 
observed values Yo. Thus AB = O when Y is replaced by Yo in (15). Now 
let Y — XBo, the “true” residual errors of the recorded observed values, be 
indicated by E. Then (15) becomes 





(16) AB = (X'X)'"X’E. 


1 is 


get 







Sampling theory can be applied to (16) to obtain a formula for the standard 
error of the regression coefficient. It is assumed that the ‘‘true” residual errors 
are independent with a common standard deviation o,. The values of AB are 
then linear functions of these errors. It follows that 








its (17) on = yn = (X’X)'X'X(X'X)“o, = (X’X) ‘oe. 













the The standard errors of the regression coefficients are thus formed by multi- 
atio plying «, by the square roots of the diagonal terms of the inverse of X’X. 
e of 













4, Standard variates. Use of correlation matrix. Many of the formulas of 
section 3 are simplified with the use of some type of standardization. In par- 
ticular it is possible to reduce the matrix X’X to the matrix R of correlation 
coefficients by replacing « by t,/N where t, = 2/s. If y is similarly replaced 
and B by B, then X’Y = R,, and Y’X = Rj,, Y’Y = Sy? = 1 and selected 
formulas from section 3 become 


(18) RB = Ri, 

























(19) B= RR, 
(20) ry.2,...2, = RB = BRB = R,,h ‘Ra. 
ma- 
nple Classical multiple correlation formulas, determinantal and otherwise, are 
“covered” by the matrix formulas (20). 
that 
5. Matrix presentation of a Doolittle solution. Least squares and correlation 
constants can also be obtained from the entries of a Doolittle solution. We first 
outline a matrix description of the Doolittle solution of the equation AX = G 
with A = [a;;] symmetric and of order n. 
Let S; be a (n by n) matrix with the first row composed of the elements ay; 
and all other elements 0. Let 7; be a similar matrix with first row elements 
b,; = a,;/ay and all other elements 0. Then A — 8:7; = Ai = [a; jal is a sym- 
— metric (n by m) matrix with all elements of the first row and the first column 0. 
din Next let S. be a (n by n) matrix with second row elements a2; = de; — dab; 
ini and all other elements 0. Let T2 be a (n by n) matrix with second row elements 
lem. 


boj1 = @2;1/ax2., and all other elements 0. Then it follows that the matrix 
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A, ~ BY. = [a:j.2] is a symmetric (n by n) matrix with the elements of the 
first 2 columns and the first 2 rows all 0. 

This process is continued through successive steps, an additional row and 
column being made identically 0 at each step, through n steps. At the end of n 
steps we have the result. 

(21) A — ST, — S:T, — --- S,T, = 0. 


This development, when applied to each side of the matrix equation, provides 
the basis for an equation solving technique which Aitken has called the ‘‘method 
of pivotal condensation” (8) but which the author feels is more adequately 
characterized as the ‘‘method of single division” (9). The Abbreviated Doolittle . 
method can be obtained as an abbreviation of this method. It is not neces- 
sary to compute all the elements of the successive matrices A;A2 --- , ete. but 
only the non-zero elements of the 8,, 7; , S2., Ts ---+ ete. matrices. 

Consider the so called triangular matrix S = S; + Se -+ S83; + --- + S, with 
its rows composed of the non-zero rows of the S;. Consider also the matrix 


T=7,:+7.+---+T7,. Then 

(22) S'T = SiTy + SoT2 + +++ + SATs 
since ST; = (0 when + j. 

It follows that (21) can be written 

(23) A-— ST = 0. 


An efficient way of building up these matrices S and 7’ in practice and in making 
the corresponding transformations on the right side of the equation is the 
Abbreviated Doolittle method. It is apparent from (23) that the Doolittle 
method is directed, in part at least, toward the factorization of the symmetric 
matrix A into two triangular matrices. 

It should be noted that these triangular matrices are related by the matrix 
formula 


where D is the diagonal matrix with diagonal elements ay, G22.1 , 433.12 , *** 
Cit ssand » 

Operations performed on the left of the matrix equations AX = G are also 
performed on the right side so that the Doolittle technique results in the estab- 
lishment of the auxiliary matrix equations. 


(25) SX = SAG. 
(26) TX = TAG. 


A simple outline (n = 3) of the form of the Abbreviated Doolittle method is 
presented for the purpose of identifying these matrices. A is symmetric and G 
is the column matrix [aja]. 


es 
od 
ly 


S- 


ut 


th 
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a Ap ai3 a4 
—— Ge a23 A124 
Se ee 33 34 





a1 dap a3 | Qi4 
1 Dis bis | bis 





22.1 23-1 Ar4.1 

1 bes.1 | bea.1 
ga i a ee re — _— 
33.12 | 34.12 





1 


b3a.19 


ai 412 a3 
The matrix Sis then | 0 = az2.. 3.1. |, the matrix T is 


0 0 133.12 
1 Dy bis ais Dis 
YF bo3.1 ; SA "G is 24.1 |, TA'G is boat 
0 O 1 134-12 bga. 12 


6. Least squares and multiple correlation constants from the Doolittle solu- 
tion. The inverse of A is needed for many formulas. We set up a technique 
for solving AY = I simultaneously with AX = G. This is indicated sym- 
bolically by 

AY. @ i4 


| | 
| 


S| SA “*G | SA”. 





_—————— 
T| TAG | TA 

It follows at once that 

(27) (SA)'(TA™) = ATS’TA™ = ATAA™ = A™. 


This matrix multiplication is easily and readily accomplished when the matrices 
are in the Doolittle form. 
Similarly 


(28) (SA“)'(TA'G) = A'G =X, the matrix of solutions of AX = G and 
(29) (SA“G)(TA'G) = G’AG. 


—— . ‘ oo gant : ss 
It is interesting to note further that (SA~)’ and T are inverse triangular 
matrices since 


(30) (SA“/T = A’S'T =I. 


. mal — ° ° 
S’ and TA~ have a similar relationship. 
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In the case of least squares theory A = X'’X,G = X’Y, X = B so that the 
formulas (27)(28)(29) become 
(31) (SA™)(TA™) = A™ = (X’X)”. 
(32) (SAq')(TA’G) = X = B. 
(33) (SA7G)(TA’G) = GAG = Y'X(X'N) "N'Y 
= Y’XB = B’X’'XB = Y'’Y. 


If the normal equations are reduced to standard form A = R, X = B, G = R,, 
and we have 


(34) (SA)(TA™) = AT = RR”. 
(35) (SA”)(TA’G) = X =B. 
(36) (SA”G)(TA“G) = G’A'G = R),R"Rz, = RB = BRB = 73.2,..-2,. 


The reader is referred to an earlier paper [3, 457] for an illustration of these tech- 
niques. 

It should be noted that the solution is a cumulative one in the sense that solu- 
tions involving n predicting variables are obtained from solutions involving 
n — 1 predicting variables by the addition of paired products. This is a highly 
desirable feature as it makes possible direct analvses showing the effect of an 
added predicting variable. 


7. A more general theory—solution of matrix equations by factorization. 
Examination of the results of section 5 leads one at once to a consideration of a 
more general theory. The key formula in this development is A — S’T = 0 
and all subsequent formulas stem from this. Hence if A can be factored into 
any matrices, S’ and 7’, not necessarily triangular, the results of section 6 follow. 

From a practical standpoint it is desired that the factorization process yield, 
simultaneously, the values S, 7, SAG; TAG; SA~ and TA™‘ as the Doolittle 
method does. But, formally, these can be computed if S and 7 are known. 


8. A “‘square root’? method. A most interesting and practical special case 
of the above method is that in which the triangular matrices S and 7’ are equal. 
It appears that a technique based on this property would have some advantages 
over the Doolittle method since the double rows of the Doolittle solution could 
be replaced by single rows, while the formulas of sections 5 and 6 are just as 
applicable. Now such a technique is easily devised. From (23) and (24) we 
see that 


(37) A — S'D"S = 0, 


where D is a diagonal matrix. 
- —} ~Y Y —} y “se 
We replace D™’S by a new S, (D’’*S)’ by a new S’ and have 


(38) A— S’S = 0. 
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The technique of solution is similar to that of the Doolittle except that the 
entries 8;;.... are ai;..../~/a;;.....These values s;;.... are thus geometric means 
of the values aj;;.... and b;;..... 

A simple machine technique is available for computing these entries. In 
some respects the solution is superior to the Doolittle solution. It is hardly 
pertinent to the subject matter of this paper to present a detailed discussion of 
the merits of this method, with the numerical illustrations. This will be done 
in a later paper. 

After arriving at this method by the steps described above, it seemed surpris- 
ing that such a simple and compact method has not been discovered by some 
previous worker. Although matrix factorization is not a new subject, I have 
not found evidence that it has been utilized so directly in the problem of solving 
matrix equations. The nearest approach I have discovered is the paper by 
Banachiewicz [10], in which a “square root” method is used in factoring A. 
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ON THE STATISTICS OF SENSITIVITY DATA 
By BENJAMIN EpsTEIN AND C. West CHURCHMAN 


Frankford Arsenal 


1. Introduction. ‘Sensitivity data” is a general term for that type of ex- 
perimental data for which the measurement at any point in the scale destroys the 
sample; as a consequence, new samples are required for each determination, 
Examples of such data occur in biology in dosage-mortality determinations, 
in psychophysics in questions concerning sensitivity responses, and, more 
recently, in the theory of solid explosives, in questions concerning the sensitivity 
of explosive or detonative mixtures. 

Methods of analyzing such data have been discussed by Bliss’ and Spearman’, 
and others. The present paper is a generalization of Spearman’s result; it is the 
feeling of the authors that Spearman’s method, if properly founded in mathe- 
matical theory, is preferable to Bliss’, for it does not necessitate the assumption 
of some type of distribution prior to analysis, and hence resembles the standard 
treatment of independent observations made on the same object. 

Throughout the following discussion, we let x; be the magnitude of a certain 
“stimulus” (be it dosage, physical stimulus, or strength of blow) and p; the cor- 
responding fraction of objects unaffected by the stimulus. Bliss’ method con 
sisted in assuming that the p; represented the cumulative distribution of some 
known function (in his case, the normal function), and hence the p; could be 
transformed into a variable ¢; linearly dependent on the x;. The difficulty of 
this treatment, in addition to the distribution assumption, lies in the fact that 
the ¢; do not have equal standard errors, and the straight line fit is very cumber- 
some, 

Instead, Spearman makes the much simpler assumption that if p; is unaffected 
at a;, and pis; at rig, then p; — pisi is an estimate of the fraction that is just 
affected (i.e., the fraction of those that have ‘‘critical’’ responses) at about 
Lr; + Xia1). Ii the x; are evenly spaced, as we shall assume them to be through- 
out, and p; = 1.0 and p, = 0, then any set of sensitivity data may be trans- 
formed into a set of data on critical responses classified into classes whose mid- 
points are evenly spaced. Without loss of generality, we shall assume the 2;’s 
to be integers and the intervals to be unity. The data on critical responses can 
then be treated in the normal.way, and X and all the measures of dispersion 
calculated in the usual fashion. In order to justify such procedures, however, 
it is necessary to show how the sampling errors of X and the higher moments 
can be estimated. 


1C, I. Bliss, “The calculation of the dosage mortality curve,’ Annals of Applied Bi- 
ology, Vol. 22, pp. 134-167. 

2C. Spearman, ‘““The method of ‘right and wrong cases’ (constant stimuli) without Gauss’ 
formulae,’’ British Jour. of Psych., Vol. 2, 1908, pp. 227-242. 
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2. The moments and their errors. By definition, 


n n 


X =) (pi — piv) (ei + tinn)/2 = DS (pi — piss)(ti + 4). 
i=1 i=] 
If we let x; represent the stimulus for which none of the samples can be affected, 
then 


n—1 
(2) X=u+5+ 2 pi, 

i=2 
as Spearman has shown (3). Since 2; is constant, and the p, are all independent 
(non-correlated), it follows that (V; being the number of objects in the 7th 
sample) 


n—1 


(3) ; S ig Sa + Wns + eee Hh Tm = Zz On, = ie ae 


. 


(since o5, = o>, = 0). 


Again by definition, the gth moment about the origin is 


(4) Ma - Za. (pi — pis1)(%i + 43)’. 


i=1 


As before x; + .5 can be taken as the origin (2; + .5 = 0), in which case we have 


/ 


Ma = (pi — p2)-0% + (p2 — ps)-1* + (ps — ps) + 2% 
+ wa + (Pn—1 _ Pn)(n ell 1)*. 
If we let b,,; represent the 7th first difference of the consecutive gth powers of the 
positive integers (including 0), then 
n—1 


(6) My = in boi Di 5 


1=2 


by expansion of (5). Hereafter all = will be taken from i = 2 to 7 
Evidently 
n—1 
@) i= Bute). 
i=2 Ni 
or 
n—1 


2 2 2 
(8) Cus = i bo.80'n, . 


=e 


We are interested now in the standard error of the gth moment about the sample 
mean. To obtain this, compute first the correlation between the gth and rth 
moments about the origin. 
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2 4. . / . ° i > 
If du, is taken to be the sample error in u, due to deviations dp, from the true 
values, then we have 


n—1 
Su, = > baid 


t=2 


n—1 
, e 
Our Ze bi pi « 
t=2 


Sug bu, = zi bai b,,:(6pi) > a (bq,i Or,7 A bg, br,1) 5p: 5D; 
iA] 
Summing for all samples: 
Op, Cu) 7 = Do babe op, ae a (bg, br, ; oe bg,5 br.) (op; Op; Tpsp;) 
= Do dabei, - 


Since evidently r,,;,; vanishes for all i ¥ 7 (the p; being completely independent 
in the statistical sense). 
. / , a 
In particular, when uw, = uw, = X, we have 


(9) 


9 
(10) Ou, OX yx = Ubi,i0p; - 
By definition, the gth moment about the mean will be 


(11) Mo = XU(pi — pinid(xi + 3 — X) = Dp, (2, 


/ 
where pi = Pi — Piii- 
For computational purposes, this may be written as 


\ —1) ge, or = 
(12) Pe" Le ‘as u Q ) Xu + ee + ia Mag—r+1 + oo + X* 


= s _— — 
where X = Tp; = w1, if x, + 4 is the origin. 

To obtain o,, , where X is estimated from the sample, we may follow the usual 
procedures, arguing that 


(13) Sug = Vi(ae + 3) Spi} — dX B(x + 3) 'p, + T 


where 7’ contains terms involving X and higher powers of X. 
From (13) we obtain 


, 


2 2/7292 , , 
(14) wg = Fu, H Po g-10x — Wu_asxoyiTxn, + L 
where U involves X and higher powers. From (3), (8), (10) and (14) we have 
» , 2 2 dn ‘es 2 , 
(15) Cn, Xbq iF p; + Q Mg-1% p; — 2b g—1 by, io p; + ¢ 
= 2(b,.:- itn— iT “ + U, 


y °° * > ° y e / 
We now shift the origin to X. All the terms in U vanish, y,-1 becomes u,-1, 
and the b,,; values go into 8,,;, where 


Boi = Gi — X)* — (i — 1 — X)*. 
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That is, (15) becomes 
(16) a2, = 28,5 — tes)", 


It is of interest to give an alternative proof of the relation (16) possessing the 
desirable property of being very short and simple and at the same time yielding 
an expression for the 8,,; in terms of b,,,(1 <r < q) and powers of X. 

If z; + .5 is taken as the origin, then (11) may be written as (17) 


(17) My = Si — X)*p;. 
The application of the 6-operation to both sides of (17) yields: 
(18) bug = S(i — X)*Sp; — gd(i — XX) pyeX 
(19) = = (8,5 — Géa-1)6p5 « 
Repetition of a previous argument gives the result: 
(20) te = 2(Byi — Gy-1) Op, - 


In order to derive the relation connecting the 6,,; with b,,;(1 
. > 4. . . . e 
expand S(7 — X)*6p; in equation (18). This expansion yields: 


DG — X)%sp; = Do? — Cit KX + (Coit OR? 
eee fH (—1)7* Cpt + (—1) Xp; 
Dd (bas — g@Cid—-1.X + gCobq-2.5 X° 
tees (1) GX ,s) 5p: 


< r <q) we 


Bai = bai ad m6) bg-1,5 X gC2 bg-2,i _ 


22 v 
( ) qe eee Ht (— 1)*"qgX*"bi . 


The relationship (16) combined with (22) enables one to compute the standard 
errors of a number of useful statistics. In particular in case gq = 2 it follows that 


(23) i. =or = Yh; — 2X)*o%,, , 
Combining (23) with the well-known result that 
(24) Os = G,,/20 
we see that 
wv >. {Gi — 3) ~ 22 )'e,. 
0 = rr 
2V >> (2i — 3)p: — (Spi) 


Formula (25) is useful in significance tests involving the standard deviations of 
sensitivity data. 


(25) 


3. Standard errors of the moments in standard units. We now turn our at- 
tention to the derivation of the standard error of the higher moments when 
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expressed-in standard units. Before proceeding with the derivation it is con- 
venient to find the correlation between the gth and rth moments about the mean. 
This result is an immediate consequence of (19), for since 


_—  § is 

bug “eo =i q,i — QMo-15 Opi 
and 
(26) Sur = Bri, — Turis 6p; 
it follows that 
27) OMgour = ~ {Boi = Géy-13 Br, i = Yor-15 (Opi) + Z 
where Z contains terms 6p;6p;(¢ # j). Hence, as before, 

i ee ‘ : 
(28) TugF up! guy — 2 1Ba.i — Gho-1$ (Bri — TupysOp; - 
Let us now derive the standard errors of the moments in standard units, i.e., of 


(29) 


Now in general, 
(30) 
and since 


(31) 


we have 
(32) 
and hence 


, > 40°(5uq)” + Gu (Su) — 4q0° po bug Sus 
(33) (6a,)* = ee 


» 9 9 9 94 
tus Gug + q Ma Guo net 4qus Mg Fp Fu Tuono 


34 Ca, = 3 
= 4u2™ 
In this case, it follows that 


9 9 


4us D0 (Bai — Qo) op; + Fey Dy B25 95, : 
(35) | — Aqug ue Do (Boi — Gite-1)B 2,1 0; 
oO q+? 
dus” 


Zz (Qu2(Ba, aie qutg—1) aa Gg Bo, ) 
4yg*? 
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If the gth moment about the mean vanishes, then 


9 


(37) - ia dus Z (,. e QWo-1) v5 ae Cu, 
, Fa, 4, tt? ane i 

M2 M2 
{t is readily seen that the stand: ard errors of the skewness and flatness are special 
cases of formula (36) when g = 3 and q = 4 respectively. 


4. Some minimization problems. In the analysis of sensitivity data it is most 
desirable to minimize ox or o;2 in order to increase the precision of significance 
tests involving X or o respectively. Therefore, it is of interest to solve the 
following problem: ama that we have a sample of size N which is to be sub- 
divided into n s: amples ot size N; to be tested at a number of fixed levels {2;}, 


1,2---n, - N; = N. Then what choice of values {N;} will minimize 


ox e ae where >) N; = N? 


t=1 N i=l 


In order to solve this sili most quickly we use the method of Lagrange 
multipliers, i.e., we minimize the expression 


‘. 0: Oi ~ P 
(38) L(N:,) = _* $0(3 N; - v). 
t=1 2 i=1 
Taking the partial derivatives with respect to NV; we obtain the n equations 


Mz? 


(39) PU», ie, N= VP j= 1,2- 


oe 5 Tes 
N? ; 


i 


Summing over all values of 7 we obtain 


(40) N = >, V pias 


Qu. NI? ol 


, the best choice of values for {N;} is given oy 

, NV DiGi 

(41) N; = Nv'pias 
pm V didi 


t=1 


The value of o% for this choice of the set {N;} is 
(S vna) 
t=1 

N 


It is obvious that this is actually a minimum. In particular, it is less than the 
value of «= for N; = N, = N/n (the number of groups is n). This follows from 
the application of Schwartz’ inequality to (42), for 


(= vai) n do Didi, 
< i=l 


1=1 
~ —— ee 


(42) 
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which equals the value of oj for Ni = No = --- . The equality 
holds if and only if py = po = --: = pn. 
Suppose next that we wish to minimize 


2 be; — 2X Yi 
(44) => © Ss X)* pig, = 5 fst 


where 
Boi = bes — 2X. 
We proceed as before to minimize the expression 
- >? 
(45) L2(N iy d) oa 
cama , - . “ ot a 
Taking partial derivatives with respect to N; we obtain 


Blip... yr [Baldo 
(46) V2 z= ie. N, = a8 —', ¢= 1, 2, seem 
VG 
or summing over all values of 7 we obtain 


~ | ; | 0: 0; . ee ice | me 
(47) N= Z. Be. ba or NZ = z. is pees 
i=l . i=1 me 


° . . yf e e 
e., the best choice of values for |.V;} is given by 


ri hd ae, 
(48) N= N | Bas! V Bids | 


r 


>| Be,i | A pid 


The minimum value of a3: is given by 


n 2 
(= | Be,s | V pits) 


(49) V 


In practice we desire a set {N;} which will make o% and o%2 small simultane- 
ously. Unfortunately this is not in general possible. In fact, it may be asserted 
that the set {N;} minimizing, o% will yield a large value of o;2 and similarly the 
set {N;} minimizing 72 will yield a large value of «=. The reason for this curious 
behavior lies in the fact that the only difference between the set |N;} and the 
set {Ni} is the set of numbers f | 8.,;|} = {| (2i — 3) — 2X |}. These num- 
bers, however, change the character of the sets |N;} and {1 Ni}. In particular 
‘N.} takes on its largest values for both small and large values of 7, whereas 
{N,} takes on small values in these regions; }! "’! takes on small values for those 
“ie of i which are the integral values closest to X + 3/2, whereas {N,} takes 
on large values for such values of 7. It is this curious juxtaposition of {N;} and 
{N;} that renders it impossible to choose sets of numbers {N;} minimizing o% 
and o72 simultaneously. 





NOTES 
This section is devoted to brief research and expository articles, notes on methodology 
and other short items. 
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NOTE ON RUNS OF CONSECUTIVE ELEMENTS 


By J. WoLrow1tTz 
Columbia University 
In my paper [1] I did not derive the asymptotic distribution of W(R), an omis- 
sion which I wish to correct in this note. 
Let the stochastic variable R = (1, --- , 2.) be a permutation of the first n 


positive integers, where each permutation has the same probability i . Asub- 
n 
sequence 2541, Li42, °** , Liz, iS called a run of consecutive elements of length 
l if: 
a) when I’ is any integer such that 1 < l’ < l, 


| tise — Vigvegi | = 1 


b) when 7 > 0,| 2: — 2i41| > 1 

ec) wheni + 1 < n,! Xi42 — Visti! > 1. 
Let W(R) be the total number of runs in R. Then n — W(R) is a stochastic 
variable which, it will be shown, has in the limit the Poisson distribution with mean 
value 2. More precisely, if p(w) is the probability thatn — W(R) = w, then 


. 2” 
(1) lim p(w) = aa 


Proor: Define stochastic variables y;(¢ = 1, 2, ---, n), as follows: y; = 1 if 
z; is the first element of a run of length 2, y; = 0 otherwise. It is easy to see 
that the probability that x;(¢7 = 1, 2, --- , n) be the initial element of a run of 


» 


length greater than two is O (} ) and hence that the probability of the occurrence 


of a run of length greater than two is O (*) . Hence the limiting distribution of 


n — W(R) is the same as that of 


n 


y= Du, 


t=1 
provided either exists. 
The y; are dependent stochastic variables and almost all (i.e., all with the ex- 
ception of a fixed number) have the same marginal distribution. We now wish 
to consider the expression 


E(yi! yis *** Yar) 
(where the symbol E denotes the expectation) for any set of fixed positive in- 


tegers k, ai, --+ , a, and for all k-tuples 7; , 72, --- , 7%, with no two elements 
97 
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equal. Now 
Ely yis +++ Yar) = Ely yin +++ Yur) 


is the probability that yi, = 1, yi, = 1,---, yi, = 1, simultaneously. This 
probability is either zero (for example, when | 72 — 4) = 1, | 7; — %#)| = 1, ete. 
, s\° 1 el 
or when 2; = n, ete.) or (; +O = }- Moreover, the ratio of the number of 
\n il 

k-tuples 71 , 72, «++ , 7 for which the probability is zero to the number of k-tuples 
’ ae. | 4 ; %. l ~— 

for which the probability is(?) + O|—~ JisO{-]}. Let Z(t = 1,---,n) be 

n get n 

independent stochastic variables each with the same distribution such that the 
probability that Z; = 1 is 2/n and the probability that Z; = 0 is (n — 2)/n. 
It follows readily that the limit, as n — ~, of the jth moment (7 = 1, 2,---, 
ad inf.) of y about the origin, is the same as the limit of the same moment of Z, 
where 


Z=)>Z;. 
i=l 


Since the Z; are independently distributed, and since each can take only the 
values 0 and 1, the probability of the value 1 being 2/n, the jth moment of Z 
about the origin approaches, as n > =~, 

hj = e” 2d a ’ 

which is the jth moment about the origin of the Poisson distribution with mean 
value 2. By the preceding paragraph, u; is also the limit of the 7th moment of 
y about the origin. Now von Mises [2] has proved that if the jth moment 
(j = 1, 2, --- , ad inf.) of a chance variable XY, , (n = 1, 2, --- , ad inf.), ap- 
proaches, as n — ~, the jth moment of a Poisson distribution, then the dis- 
tribution of XY, approaches the Poisson distribution with corresponding mean 
value. From this it follows that y has in the limit the distribution (1). We 
have already shown that y and n — W(R) have the same limiting distribution, 
so that the required result follows. 
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NOTE ON CONSISTENCY OF A PROPOSED TEST FOR 
THE PROBLEM OF TWO SAMPLES 


By ALBertT H. Bowker 
Columbia University 


Certain tests for the hypothesis that two samples are from the same popula- 
tion assume nothing about the distribution function except that it is continuous. 
Since the power functions of these tests have not been obtained. optimum 
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tests are not known. However, one desirable’ test property, that of “consist- 
ency,” has been introduced by Wald and Wolfowitz [1]. A test is called con- 
sistent if the probability of rejecting the null hypothesis when it is false (the power 
of the test) approaches one as the sample number approaches infinity. This is a 
logical extension of the familiar idea of consistency introduced by Fisher. It 
will be shown that a test recently proposed by Mathisen [2] is not consistent 
with respect to certain alternatives. 

The test proposed by Mathisen [2] may be described briefly as follows: Given 
two samples, observe the number (m) of elements of the second sample whose 
values are less than the median of the first sample. The distribution of m is 
independent of the population distribution under the null hypothesis. Let 
P{m < a} denote the probability of the relation in braces under the null hy- 
pothesis. If m; and m: are significance points (m; > mz) such that 


P\m > m} = Bi 
(1) P{m < ma} = Bs 
B+ = 6 <li, 


the statistic m can be used to test the hypothesis at the significance level £. 
This is called the case of two intervals. The method is extended by using the 
two quartiles and the median of the first sample to define four intervals into 
which the elements of the second sample may fall. If the second sample is of 
size 4n and the number which actually falls in each interval is n,, ne, n3, and 
n, respectively, the distribution of . 

4 


dD (nz — n)? 


t=1 


(2) t= > 





9 
n° 


is also independent of the population distribution under the null hypothesis. 
Then if C* is a significance point, such that 


(3) PiC >C*} = 6’ <1, 


C' can be used as a test of the hypothesis at the level 6’. 

To show that Mathisen’s test is not consistent, we shall consider first the case 
of two intervals. Let X and Y be two independent stochastic variables whose 
cumulative distribution functions F(x) and G(x) are continuous. Let 
Wy <ato-+s < Hong, and yy < yo-++ < yo, be sets of ordered independent observa- 
tions on X and Y. Then m is such that 


Yn < Un+1 < Ym+i - 


Let m, and m, be the significance points of the distribution of m, defined by 
(1). Clearly m; and mz depend on n. We shall prove that the sequence 


(4) m(n) 


Qn 


= 





24= a. coee 


1For large samples. 
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converges to 3. Since (4) is bounded, it has at least one limit point. Let h 
be such a limit point. Ifh < 3and 4 — h = 36, then there exists a monotonically 
increasing subsequence of the integers n;, m2, --- and a number N such that 
for n; > N 


‘ /mi(n ; 
(5) (mi) _ hi <6. 

2n; 
Clearly m/2n converges stochastically to 3. Hence if 0 < € < 1 is any arbi- 
trarily small number, we can select n so large that the probability is at least 
1 — e that 
1 


(6) bed < 6. 


\Qn 2 


Hence for n sufficiently large, P}m > mj} is at least 1 — e€, a contradiction with 
(1). A similar contradiction appears if h > 34. Hence (4) has only one limit 
point, 3. In the same way we can prove that the sequence 


(7) m2(n) 


4. @ seus 
Qn n , =? 


also converges to 3. 
Let 0 < 6 < §. Consider now two pairs of populations, A and B, described 
as follows: 


A) F(a) = G(z) =: 
B) F(x) =z 
G(x) = 0 
G(x) = (a — 3 + 26)(3 — 
G(z) = 2 
Giz) = 4+ 6 
G(x) = (4 + 6) + (@ — 14+ 6)(3 — 4)/6 _ £ 


For both A and B, F(x) = G(x) = O for zx < Oand F(x) = G(x) = 1 forz > 1. 
For B, it will be shown that there exist values of n greater than any preassigned 
arbitrarily large number, such that the probability of rejecting the hypothesis 
when it is false is less than 6, +°®. + € where « is an arbitrarily small positive 
number. 

Let hy , ho , hg denote the number of observations on XY which fall in the inter- 
vals0O <x <4 —6,4 —6<27<3446,34+ 6 < x < 1 respectively for a fixed 
value of n. Let hy, hs, hz be the corresponding numbers for Y. For a fixed 
n, the probability of a set hy , ho, hs, hi. hs , hg is the same whether the samples 
be drawn from A or B. From (4), (7), and the stochastic convergence of m/2n, 
it follows that we can find an N such that for all n > N the probability is at 
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Jeast 1 — ¢€/2 of the occurrence of a set h;, ho, hs, hi, Ne h3 for which Fur 
In+1, Ym, Will fall in the interval (3 — 6, 3 + 6). Furthermore, for fixed hz , 
hs the distribution within the interval is the same whether the sample came from 
Aor B. Hence, even when the sample is drawn from B, for n sufficiently large, 


Pim > mj} < f+ 5 


P{m < m} < Bt 5. 


That is, for samples of sufficiently large size from B, the probability of rejecting 
the null hypothesis is at most 8; + B2+ «. Since 8; + SB < 1 and eis arbitrarily 
small, the probability can be made less than one and the test is not consistent 
in the case of two intervals. 

In the case of four intervals, the proof is similar. In this case, we assume 
that the second sample has size 4n. Clearly, m/4n, neo/4n, n3/4n, and n4/4n 
converge stochastically to 3. If C* is the significance point defined by (3), the 
sequence 

C*(n) n = 1, 2,--- 


converges to zero. Now consider two pairs, A and B, of populations. A is the 
same as before and B consists of one uniform distribution and one which is 
identical with the uniform distribution in small intervals containing z = 3, }, 
3 and 1, but is different everywhere else. As before, F(x) = G(x) = 0 for 
« < Oand F(z) = G(x) = 1 forz > 1. Then for B, when n is large, the be- 
havior of C, except for a probability arbitrarily near zero, will depend only 
on the intervals of coincidence. Hence for B 


PiC > C*} < # + « 


where € is any arbitrarily small positive quantity. 

Returning to the case of two intervals, if the samples are from different popula- 
tions and if their cumulative distribution functions are identical in the neighbor- 
hood of their medians, the test is not consistent. If such a possibility is excluded 
from the class of admissible alternatives, we may expect that the test will be 
consistent. For example, if the class of alternatives is limited to those where 
G(x) = F(x + c), c a constant, the test will be consistent. A similar remark 
holds for the case of four intervals or for any fixed finite number of intervals. 
It appears, however, that if the number of intervals is a function of the sample 
size (say ~/n) and becomes infinite with sample size, a test of this kind will be 
consistent with respect to a general class of alternatives. 
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HENRY LEWIS RIETZ—IN MEMORIAM 


By A. R. CRATHORNE 


University of Illinois 


Forty odd years ago few if any American college catalogs mentioned the words 
‘‘mathematical statistics.”” The word “actuary” often called for the use of a 
dictionary. Some courses in the theory of probability, theory of errors, or 
method of least squares touched on some phases of statistics but aside from this 
there was little interest in the subject. In England at this time Karl Pearson 
was well started in his work at University College but ‘‘Student”’ was an under- 
graduate student. In Germany, Lexis was finishing his somewhat unrecognized 
labors at Goettingen. In Denmark, Thiele, and in Norway, Charlier were lec- 
turing and writing on statistics from their own individual viewpoints. 

During the four decades which have passed, the interest in theoretical statistics 
in the United States has increased to the point where it has a well established 
journal of its own and few university mathematical departments fail to list 
statistical courses. In this growth no one has had more influence than the sub- 
ject of this memoir. His published papers, his personality, his students and his 
well directed energy have all been more than helpful in putting mathematical 
statistics where it is today. 

Henry Lewis Rietz, son of Jacob and Tabitha Jane Rietz, was born August 24, 
1875 at Gilmore, Ohio. He attended the local schools and in 1895 entered Ohio 
State University receiving his B.S. degree in 1899. After graduation he went 
to Cornell University as scholar, then fellow and assistant in mathematics. 
During his stay at Cornell he was closely associated with two other mathematical 
students, J. W. Young and H. W. Kuhn, later heads of the departments of mathe- 
matics at Dartmouth and Ohio State University respectively. In his last year 
Rietz was particularly interested in group theory and worked for his doctorate 
with Professor G. A. Miller who was then a member of Cornell’s faculty, His 
dissertation was “On primitive groups of odd orders,” published later in the 
American Journal of Mathematics and referred to in the Encyclopedie des Sciences 
Mathematiques. After receiving the Ph.D. in 1902 he spent one vear as professor 
of mathematics and astronomy at Butler College in Indianapolis. 

In 1903, Rietz accepted an instructorship at the University of Illinois where he 
stayed until 1918 becoming full professor in the meantime. In 1918 he was 
called to the University of Iowa as head of the department of mathematics, a 
position he held until his retirement in 1942. 

During his first year at Illinois his interests were mainly in pure mathematics. 
His advanced courses were ‘Theory of Invariants”’ during the first semester and 
‘Higher Plane Curves” during the second. During the next year a demand 
arose for some course in statistics. None of the members of the mathematics 
department were particularly prepared to give such a course but Rietz was 
induced to try it. The result was that he offered a course ‘‘Averages and 
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Mathematics of Investment.” This curious title was evidence of the fact that 
actuarial science had not reached the independent position that it has at the 
present time. In the following year he was appointed to the position of statisti- 
cian of the College of Agriculture and from that time on during his stay at 
Illinois he divided his time equally between the department of mathematics and 
that college. His work as statistician was mainly supervision of the statistical 
work in the published bulletins. The first publication in the statistical field 
under his name was the 32-page appendix to Dean Davenport’s treatise on 
breeding. 

The first published statistical study was in 1908, a master’s thesis for Miss 
Shade on ‘Correlation of efficiency in mathematics and in other subjects,” 
printed as one of a series of University Studies. It is interesting to recall the 
attention which this paper received, especially from educational circles. It 
seemed to fix the method and form of calculation of correlation coefficients which 
occupied the time of many people during the following years. In these early 
years it was rather difficult to find a place of publication for a mathematical 
paper on statistics. Mathematical journals were somewhat reluctant in accept- 
ing articles. I remember One occasion when he jokingly complained of the 
correspondence necessary to explain to an editor the word ‘correlation’ used 
in a paper. 

From 1908 on, Rietz published a long list of papers on statistical topics, some 
purely theoretical, some expositional, some arising out of his connection with the 
college of Agriculture. Together with his later actuarial studies the list totals 
150 titles, the more important of which are included in this article. His much 
quoted paper of 1920 on **Urn Schemata”’ pleased him more than any other paper. 
His little book Waihematical Statistics, one of the Carus mathematical mono- 
graphs, written in 1926 was the basis for many university courses for vears 
afterward. 

In 1909 the American Institute of Actuaries was organized in Chicago, and 
Rietz was a charter member. He took particular delight in this organization 
and was rarely absent from the meetings. He was elected vice-president in 
1919. He liked meeting practical actuaries and had a wide acquaintance among 
them. In 1916 he was appointed a member of the Illinois Pension Laws Com- 
mission and became its actuary. From that time on his interests were pretty 
evenly divided between mathematical statistics and actuarial problems connected 
with pensions. He was appointed actuary of the Chicago Pension Commission 
in 1926, was consulting actuary for the Presidents National Committee on 
Economie Security 1934, and was a member of the board of trustees of the 
Teacher’s Insurance and Annuity Association 1934-38. His services as a con- 
sulting actuary were sought by a great many pension projects both in educational 
and in business circles. When he went to the University of Iowa in 1918, he 
accented actuarial theory in his teaching. Under his leadership the department 
became an outstanding school in this field. Many of his students hold prom- 
Inent positions in the actuarial world. 
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In 1923, Rietz with eight others was appointed a member of the Committee 
on the Mathematical Analysis of Statistics of the division of Physical Sciences 
of the National Research Council. The work of this committee developed into 
the preparation of the ‘Handbook of Mathematical Statistics’ with Rietz as 
Editor-in-Chief. This work had considerable use for a number of years after its 
publication and is an important part of the history of mathematical statistics 
in this country. A Russian edition of this book appeared in 1927 with a very 
long preface as a sort of apology for the translation. A few excerpts from this 
preface are—‘‘Mathematical statistics is a purely technical weapon, politically 
unbiased, can serve with equal facility either to thwart or to expedite the move- 
ment for the emancipation of the proletariat depending in whose hands it happens 
to be;” ‘‘Mathematical statistics has nothing to do with philosophical enlighten- 
ment;’’ ‘Hence this book harbors no dangers for a soviet reader;’’ ‘““The fact that 
the western authors work in a bourgeois society has no bearing on their methods.” 

The Institute of Mathematical Statistics was organized in 1935 with Rietz as 
the informal chairman of a steering committee during the months of discussion 
preceding the organization. He thus became the logical first president. He 
has taken a more than active interest in the Institute,—as a contributor to 
the Annals, as one of its editors, as general counselor, as a good friend. In 
appreciation of this and in recognition of his contributions to the initiation and 
development of mathematical statistics in America, the 1943 volume of the 
Annals of Mathematical Statistics was dedicated to him, on the occasion of his 
retirement after twenty five vears of service as head of the department of mathe- 
matics at the University of Iowa. 

Professor Rietz received many honors in other fields. He was President of 
the Mathematical Association of America in 1924, vice-president of the American 
Statistical Association in 1925, vice-president of the American Mathematical 
Society 1928-9, and a member of the editorial staffs of the Bulletin and the 
Transactions of that society for many years, president of the lowa Academy of 
Science, 1931. He was starred in American Men of Science, a fellow of the 
Royal Statistical Society of London, and of the American Association for the 
Advancement of Science. He took great interest in local affairs and held many 
offices in church, social and business organizations in Iowa City. His mind was 
not altogether centered upon research and the development of mathematics and 
statistics. He took great pride in his teaching. He was the principal author 
of a number of college texts in mathematics that had wide use, and was on many 
committees concerned with the -problem of teaching mathematics to under- 
graduates. 

At the time of his retirement, Professor Rietz was in failing health and was 
practically an invalid until the time of his death at the University Hospital at 
lowa City on December 7, 1943. He leaves a brother, Professor John Rietz, 
Morgantown, West Virginia, and a sister, Mrs. T. S. Taylor, Caldwell, New 
Jersey. 
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SELECTED TITLES oF PusBuications BY H. L. Rietz 


“Qn primitive groups of odd order,’’ Amer. Jour. of Math., Vol. 26 (1904), pp. 1-39. 

“On groups in which certain commutative operations are conjugate,’’ Trans. Amer. 
Math. Soc., Vol. 5(1904), pp. 500-508. 

“Simply transitive groups which are simple groups.’’ Bulletin Amer. Math. Soc., Vol. 

11(1905), pp. 545-46. 

“Statistical Methods. Appendix to Principles of Breeding.’’ A Treatise on Threm- 
matology by E. Davenport, Ginn and Co., Boston, 1907, pp. 681-713. 

5. ‘Correlation of efficiency in mathematics and efficiency in other subjects—A Statistical 
Study,’’ Rietz and Shade. The University Studies, Urbana, Illinois, November 
1908, 20 pp. 

. Statistical Methods Applied to the Study of Type and Variability in Corn, Eugene Daven- 
port and Henry L. Rietz, Bulletin No. 119, Illinois Agricultural Experiment 
Station, 1907. 

. “On inheritance in the production of butter fat,’? Biometrika, London, Vol. 7(1909), 
pp. 106-126. 

5. “On a mean difference problem that occurs in statistics,’?’ Amer. Math. Month., Vol. 
17(1910), pp. 235-40. 

. “On the metabolism experiment as a statistical problem,’’ Rietz and Mitchell. Jour. 
of Biol. Chem., 1910. . 

. On the Measurement of Correlation with Special Reference to Some Characters of Indian 
Corn, Henry L. Rietz and Louis H. Smith, Bulletin No. 148, University of Illinois 
Agricultural Experiment Station, November 1910. 

. “On the construction and graduation of a rural life table,’’ Rietz, H. L. and Forsyth, 
C.H., Record Amer. Inst. of Actuar., Vol. 1(1911), pp. 9-19. 

2. “On the theory of correlation with special reference to certain significant loci on the 

plane of distribution in the case of normal correlation,’’ Annals of Math., Vol. 

13(1912), pp. 187-199. 

3. ‘Note on the definition of an asymptote,’’ Amer. Math. Month., Vol. 19 (1912), pp. 89-90. 

. “The determination of the relative volumes of the components of rocks by mensuration 
methods,’’ Lincoln and Rietz. Economic Geology, Vol. VIII, No. 2, March, 1913. 

. “On the mathematical theory of risk and Landre’s theory of the maximum,’’ Record 
Amer. Inst. Actuar., Vol. 11(1913), pp. 1-14. 

. “On the status of certain current pension funds,’’ Record Amer. Inst. Actuar., Vol. 

3(1914), pp. 33-53. 

7. “Group Insurance,’’ Record Amer. Inst. Actuar., Vol. 3(1914), pp. 277-79. 

3. “Degrees of resemblance of parents and offspring with respect to birth as twins for 
registered Shropshire sheep.’’ (Rietz, H. L. and Roberts, Elmer.) Jour. Agric. 
Res., Vol. 4, No. 6, pp. 479-510. 

9. “Note on double interpolation by finite differences,’’ Record Amer. Inst. Actuar., Vol. 
4(1915), pp. 15-22. 

. “On the correlation of marks in mathematics and law,’’ Jour. Educ. Psych., Vol. 7, No. 
2, pp. 87-92. 

“The operation of pension laws in foreign countries,’’ Report of Illinois Pension Laws 
Commission, 1916, pp. 19-35. 

“Actuarial Report on Pension Funds for Public Employees of Illinois,’’ H. L. Rietz, 
and D. F. Campbell, Report of Illinois Pension Laws Commission, 1916, pp. 
72-199. 

“The underlying principles of a pension plan,’’ H. L. Rietz, G. E. Hooker, and D. F. 
Campbell, Report of Illinois Pension Laws Commission, 1916, pp. 272-284. 

“Report of Illinois Pension Laws Commission,’’ Rietz and others, 1916, pp. 310. 





A. R. CRATHORNE 


“On the value of certain proposed refunds payable at the death of an annuitant under a 
pension system,’’ Record Amer. Inst. Actuar., Vol. 6(1917), pp. 62-75. 

“A statistical study of some indirect effects of certain selections in the breeding of 
indian corn,’”’ Rietz, H. L. and Smith, L. H.. Jour. of Agric. Res., Vol. 11(1917), 
pp. 105-46. 

‘Methods of providing for expenses of new business by life insurance companies,” 
Amer. Econ. Rev., Vol. 7(1917), pp. 832-38. 

‘“‘A Report to the Trustees of the Carnegie Foundation by the Commission Chosen to 
study and report upon the Proposed Plan of Insurance and Annuities,’’ Rietz 
and others, 19 pp. 

‘‘Pensions for public employees,’’ Amer. Polit. Sci. Review, Vol. 12(1918), pp. 265-68. 

“Statistical methods for preparation for war department service,’’ Amer. Wath. Month., 
Vol. 26(1919), pp. 99-100. 

“Recent developments in pension plans for public employees,’’ Record Amer. Inst. 
Actuar., Vol. 8(1919), pp. 1-12. 

“Scope and advantages of courses of instruction on life insurance in American colleges 
and universities,’’ Record Amer. Inst. Actuar.. Vol. 8(1919), pp. 202-06. 

“The effect of present inflated prices on the future interest rate,’’ Record Amer. Inst. 
Actuar., Vol. 8(1919), pp. 308-14. 

“On functional relations for which the coefficient of correlation is zero,’’ Quart. Pub. 
Amer. Stat. Assn. September 1919, pp. 472-76. 

“Exposition of the main provisions of the standard plan for a combined comprehensive 
annuity and insurance system for public employees,” Illinois Pension Laws Com- 
mission Report, 1919, pp. 25-48. 

“Recent developments in pension legislation in other states of the United States,” 
Illinois Pension Laws Commission Report, 1919, pp. 201-06. 

“The world’s experience in the operation of public service pension systems,”’ I]linois 
Pension Commission Report, 1919, p. 207-14. 

“Summary of the report of the Illinois Pension Laws Commission of 1916,’’ Ilinois 
Pension Commission Report, 1919, pp. 215-22. 

“Effects of the pension legislation by the fiftieth general assembly of Ilinois,’’ Ilinois 
Pension Commission Report, 1919, pp. 223-34. 

“Tllinois state teachers’ pension and retirement system. Illinois Pension Commission 
Report,’’ 1919, pp. 235-38. 

“Industrial and institutional pension systems,”’ Illinois Pension Commission Report, 
1919, pp. 239-50. 

“Urn schemata as a basis for the development of correlation theory,’’? Annals of Math., 
Vol. 21(1920), pp. 306-22. 

“On certain properties of Makeham’s laws of morta’ity,’? Amer. JJath. Month., Vol. 
27 (1921), pp. 152-65. 

‘‘Pension systems for insurance company employees,’’ Record Amer. Jnst. Actuar., 
Vol. 10(1921), pp. I-14. 

“An elementary exposition of the theorem of Bernoulli with applications to statistics,” 
Math. Teacher, Vol. 14(1921), pp. 427-34. 

‘Frequency distributions obtained by certain transformations of normally distributed 
variates,’”? Annals Math., Vol. 22(1922), pp. 292-300. 

“**Statisties’ in a Mathematical Encyclopedic Dictionary,’? Amer. Math. Month., Vol. 
29(1922), pp. 333-337. 

“On the subject matter of a course in mathematical statisties.’? Presented before the 
Mathematical Association of America at the Symposium held in Cambridge, Dee. 
29, 1922, Amer. Vath. Month., Vol. 30(1923). pp. 155-166. 

“On certain topics in the mathematical theory of statistics.’’ symposium Lectures befor 
American Mathematical Society, Bull. Amer. Math. Soc., Vol. 3011924), pp. 
417-453. 
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. “On annuity rates,’’ Record Amer. Inst. Actuar., Vol. 13(1924), pp. 120-122. 

. “On certain applications of mathematical statistics to actuarial data,’’ Record Amer. 
Inst. Actuar., Vol. 13(1924), pp. 214-250. 

“On a certain law of probability of Laplace,’’ Proc. Internat. Math. Cong., Toronto, 

Vol. 2(1924), pp. 795-799. 

‘‘Note on average numbers of brothers and of sisters of the boys in families of N ¢ hil- 
dren,’’ Science, Vol. 60(1924), pp. 46-47. 

“On the representation of a certain fundamental law of probability,’’ Trans. Amer. 
Math. Soc., Vol. 27(1925), pp. 197-212. 

“On applications of statistical methods in actuarial science,’’ Record Amer. Inst. 
Actuar., Vol. 14(1925), pp. 102-04. 

“Mathematical background for the study of statistics,’’ H. L. Rietz and A. R. Cra- 
thorne, Jour. Amer. Stat. Assn., Vol. 21(1926), pp. 435-440. 

“On certain applications of the differential and integral calculus in actuarial science,”’ 
Amer. Math. Month., Vol. 33(1926), pp. 9-23. 

“Note on the most probable number of deaths,’’ Record Amer. Inst. Actuar., Vol. 
16(1927), pp. 25-29. 

“On certain properties of frequency distributions of the powers and roots of the variates 
of a given distribution,’’ Proc. Nat. Acad. Sci., Vol. 13(1927), pp. 817-20. 

0. Discussion of ‘‘Interpolation with modified coefficients,’’ Record Amer* Inst. Actuar., 

Vol. 16(1927), pp. 232-33. 

“On the risk problem from a mathematical point of view,’’ Neuwvienne Congres Inter- 
national D’Actuaires, Rapports, Tome IT, (1930), pp. 294-306. 

j2. “‘Pensions for superannuated employees,’’ Retiring vice-presidential address before 

Section K. AAAS, Sci. Month., March 1930, pp. 224-30. 

. “On certain properties of frequency distributions obtained by a linear fractional trans- 
formation of the variates of a given distribution,’’ Annals of Math. Stat., Vol. 
2(1931), pp. 38-47. 

‘“‘Note on the distribution of the standard deviation of sets of three variates drawn at 
random from a rectangular distribution,’’ Biometrika, Vol. 23(1931), pp. 424-26. 

‘Some remarks on mathematical statisties,’’ Retiring president’s address before the 
Iowa Academy of Science, Science, Vol. 74(1931), pp. 1-4. 

‘‘Comments on applications of recently developed theory of small samples,’’ Jour. Amer. 
Stat. Assn., Vol. 26(1931), pp. 37-44. 

“A simple non-normal correlation surface,’’ Biometrika, Vol. 24(1932), pp. 288-90. 

8. “On the Lexis theory and the analysis of variance,’’ Bull. Amer. Math. Soc., Vol. 

27 (1932), pp. 731-35. 

“Unemployment and social insurance,’’ Record Amer. Inst. Actuar., Vol. 23(1934), pp. 
147-852. 

“On the frequency distribution of certain ratios,’? Annals of Math. Stat., Vol. 7(1936), 
pp. 145-53. 

‘Some topics in sampling theory,’’ Bull. Amer. Math. Soc., Vol. 43(1937), pp. 209-30. 

“Collective insuranee,’’? Bull. Amer. Assn. Univ. Prof., Vol. 23(1937), pp. 278-81. 

“On the distribution of the ‘Student’ ratio for small samples from certain non-normal 
distributions,’’ Annals Math. Stat., Vol. 10(1939), pp. 265-74. 

“On a recent advance in statistical inference,’’ Amer. Math. Month., Vol. 45(1938), 
pp. 149-58. 


Doctorate DIssERTATIONS WRITTEN UNDER THE SUPERVISION OF PROFESSOR RIETZ 


Reilly, John Franklin, 1921. On certain generalizations of osculatory interpolation. 

Weida, Frank M., 1923. The valuation of life annuities with refund of an arbitrarily as 
signed part of the purchase price. 

Smith, Clarence De Witt, 1928. On generalized Tchebycheff inequalities in mathematical 
statistics. 





108 A. R. CRATHORNE 


Meyer, Herbert A., 1929. On certain inequalities with applications in actuarial science. 

Craig, Allen Thornton, 1931. On the distribution of certain statistics derived from smal] 
random samples. 

Wilks, Samuel Stanley, 1931. On the distribution of statistics in samples from a normal 
population of two variables with matched sampling of one variable. 

Fischer, Carl H., 1932. On correlation surfaces of sums with a certain number of random 
elements in common. 

Harper, Floyd S., 1935. An actuarial study of infant mortality. 

Olliver, Arthur, 1935. On certain mathematical developments underlying an analysis of 
general death rates. 

Knowler, Lloyd A., 1937. Actuarial aspects of recent old age security legislation. 

Olshen, Abraham C., 1937. Transformations of the Pearson type III distribution. 

Berg, William D., 1941. Theorems on certain type A difference equation graduations. 

Satterthwaite, Franklin, 1941. Developments on the theory of Chi-square. 

Garfin, Louis, 1942. A comparative study of the underlying principles of certain pension 


schemes for a staff of employees with special reference to teachers and public 
employees. 


‘The last two dissertations were under the joint supervision of Professor Rietz and Pro- 
fessor A. T. Craig. 


Books 


. College Algebra, H. L. Rietz and A. R. Crathorne, First edition, 1909, Fourth edition, 
1939. Henry Holt and Company, New York. 

. School Algebra, two volumes. H.L. Rietz, A. R. Crathorne, E. H. Taylor, 1915. Henry 
Holt and Company. 

. Mathematics of Finance, H. L. Rietz, A. R. Crathorne, J. C. Rietz. First edition 1921, 
second edition 1929. Henry Holt and Company. 

. Introductory College Algebra. H. L. Rietz and A. R. Crathorne. First edition 1923, 
second edition 1933. Henry Holt and Company. 

. Handbook of Mathematical Statistics, H. L. Rietz, Editor-in-chief, 1924, Houghton 
Mifflin Company. 

. Mathematical Statistics. Third Carus Mathematical Monograph, published for the 
Mathematical Association of America by the Open Court Publishing Co. 1927. 

. Review of Pre-college Mathematics, C. J. Lapp, F. B. Knight, H. L. Rietz, 1934. Scott, 
Foresman and Company. 

8. Plane Trigonometry, H. L. Rietz, J. F. Reilly, Roscoe Woods, 1935. The Macmillan 
Company. 

9. Plane and Spherical Trigonometry. H. L. Rietz, J. F. Reilly, Roscoe Woods, 1936. 

The Macmillan Company. 

. Intermediate Algebra, H. L. Rietz, A. R. Crathorne, L. J. Adams, 1942. Henry Holt 
and Company. 

. Review of Mathematics for College Students. C. J. Lapp, F. B. Knight, H. L. Rietz, 
1942. Foresman and Company. 





NEWS AND NOTICES 


Readers are invited to submit to the Secretary of the Institute 
news items of general interest 


Personal Items 


Lt. Col. Joseph Berkson is now stationed at Headquarters, Army Air Forces, 
Air Surgeon’s Office, Washington 25, D. C. 

Dr. Ernest E. Blanche is now Statistical Director, Office of the Director of 
Engineering, with the Curtiss-Wright Corporation at Buffalo. 

Dr. Alva E. Brandt is overseas serving as Operations Analyst for the Army 
Air Forces. 

Professor W. G. Cochran and Dr. A. M. Mood are serving as Research Mathe- 
maticians on a war research project at Princeton University. Professor Cochran 
is on leave of absence from Towa State College; Dr. Mood from the University 
of Texas. 

Mr. Robert Dorfman is overseas serving as Operations Analyst with the 13th 
U.S. Air Force. 

Mr. R. M. Foster of Bell Telephone Laboratories has been appointed professor 
and head of the department of mathematics of the Polytechnic Institute of 
Brooklyn. 

Dr. Andrew I. Peterson is now Director of Manufacturing Research at the 
Victor Division of the Radio Corporation of America, Camden, N. J. 


Dr. Edward Helly, visiting lecturer at the Illinois Institute of Technology, died 
on November 28, 1943. 

Professor Henry L. Rietz died on December 7, 1943 after a long period of 
illness. An account of Professor Rietz’ scientific life and achievements by 
Professor A. R. Crathorne appears on pp. 102-108 of the present issue of the 
Annals. 


= 


New Members 


The following persons have been elected to membership in the Institute: 


Allen, Roy George Douglas. D.Sc. (London). Reader in Economic Statistics, University 
of London. Apt. 219, 2745 29th St. NW, Washington 8, D.C. 

Burk, Mrs. Marjorie F. A.B. (Hunter) Assoc. Statistician, teorology, HQ, AAF. 
1912 Third St. NE, Washington 2, D. C. 

Churchman, C. West. Ph.D (Pennsylvania) Research Statistic. . Frankford Arsenal; 
and Lecturer in Philosophy, Univ. of Pennsylvania. Frankfora Arsenal, Philadelphia, 
Pa. 

Crump, S. Lee. B.S. (Cornell) Research Associate, lowa State College. Statistical Lab , 
Iowa State College, Ames, Iowa. 

Divatia, M. V. M.A. (Columbia) Statistical Officer, Dept. of Industries and Civil Sup- 
plies, New Delhi, India. 

Freund, John E. B.A. (U.C.L.A.) Box 4221 Westwood Village Station, Los Angeles 24, 
Calif. 
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Gill, John P. Statistician, Dept. of Research and Statistics, Federal Reserve Bank, 
Dallas, Texas. 

Lindsey, Fred D. M.A. (George Washington Univ.) 628 West 114 St., New York, N.Y, 

Maloney, Clifford J. M.A. (Minnesota) 2d Lt., Sig. C. 1535 18th St. N., Arlington, Va. 

Mandel, John. Licence en Sciences (Univ. of Brussels) 45 Kew Gardens Rd., Kew 
Gardens, N. Y. 

Mathieus, George John. B.L. (Univ. of Dayton) Shop followup—Assembly Planning, 
Douglas, Long Beach. 1853 Poppy St., N. Long Beach, Calif. 

McIntyre, Francis E. Ph.D. (Chicago) Program Officer, Foreign Economic Administra- 
tion. Rm. 2446 Temporary U Bldg., Washington 25, D. C. 

Raybould, Ethel H. M.A. (Queensland) Lecturer in Mathematics. The University 
of Queensland, Brisbane, Australia. 

Rosenblatt, Alfred. Ph.D. (Cracow) Catedratico de la Universidad de San Marcos, 
Lima. Calle Atahualpa 192, Miraflores, Peru. 

Saunders, Robert J. B.S. (Mass. Inst. of Tech.) Captain, Ordnance Dept., Inspection 
Sec., Amm’n Branch, Office Chief of Ordnance. Office Field Director Ammunition 
Plants, 3637 Lindell Blvd., St. Louis 8, Missouri. 

Schwartz, David H. B.S. (C.C.N.Y.) Assoc. Statistician, Office of the Quartermaster 
General. 338 N. Geo. Mason Dr., Arlington, Va. 7 

Solomons, Leonard M. B.A. (Columbia) -Time Study Man. 150-11 88 Ave., Jamaica 2, 
a a 

Steinberg, Joseph. B.S. (C.C.N.Y.) Associate Statistician, Bureau of Research and 
Statistics, Social Security Board. 5041 North Capitol Street, Washington 11, D. C, 

Tomlinson, Malcolm C. W. 3820 Southern Ave., S.E., Washington, D.C. 

Wilson, Edward F. Asst. Engineer, Special Projects. Bldg. 650, Research Center, Aber- 

deen Proving Ground, Md. 

































Announcements 


Washington Meeting of the Institute 





There will be a joint sectional meeting* of the Institute of Mathematical 
Statistics and the American Statistical Association at the Hotel Statler and 
George Washington University in Washington, D. C., on Saturday and Sunday, 
May 6-7, 1944. 

On Saturday afternoon there will be a session on the Theory of Statistical Infer- 
ence with Professor A. Wald and Lt. J. H. Curtiss as the speakers. On Sunday 
morning there will be a session on contributed papers and on Sunday after- 
noon a session will be devoted to Time Series with Professor J. LL. Doob and Dr. 
T. Koopmans as the speakers. 


Summer Meeting of the Institute 


The summer meeting of the: Institute will be held in conjunction with the 
summer meetings of the American Mathematical Society and the Mathematical 
Association of America, at Wellesley College, Wellesley, Massachusetts, on 
August 12-14, 1944. Abstracts of contributed papers for this meeting should 
be sent (in duplicate) to the Secretary of the Institute before July 1, 1944. 





* The Washington meeting of the Institute had been announced in the December, 1943 
issue of the Annals for April 27-28, 1944, but the date has been revised to May 6-7, in order 
that the meeting may be held jointly with the Association. 











REPORT OF PRESIDENT 


ANNUAL REPORT OF THE PRESIDENT OF THE INSTITUTE 


During 1943, the second war year in which a regular annual meeting of the 
Institute was not held, the business of the Institute was necessarily largely con- 
ducted by mail. As reported in the March issue of the Annals, the Secretary, 
the Editor of the Annals, and I met in Pittsburgh in January for discussion of the 
Institute’s affairs. Since three members of the Board of Directors do not consti- 
tute a quorum, certain proposals arising from this informal meeting were sub- 
mitted by mail to the whole Board for action. At the fall meeting of the Institute 
held in New Brunswick a quorum of the Board was present, Hotelling, Wald, 
Wilks, Craig, and action was taken on certain matters. The chief subject for 
consideration was future meetings of the Institute. It was agreed that again in 
accordance with the request of the O.D.T. no annual meeting should be planned 
for 1943. Because of the success of local meetings held in New York City in 
May and in Washington in June, it was voted to repeat these in 1944. The New 
Brunswick meeting was also very successful, and it is hoped that we may again 
hold our fall meeting in conjunction with those of the American Mathematical 
Society and the Mathematical Association of America in 1944. The desirability 
of other local meetings in addition to those in New York and Washington was 
recognized but, so far, I know of no plans for any in 1944. 

During the year two local chapters of the Institute were organized in Pittsburgh 
and Washington in accordance with regulations adopted by the Board of Direc- 
tors, and these were recognized by the Board. The sponsor for the Pittsburgh 
group is E. G. Olds, and W. G. Madow has the same responsibility for the 
Washington chapter. 

The Membership Committee for 1943 consisted of Vice-President Deming, 
Chairman, W. G. Cochran, P. 8. Dwyer, and A. J. Lotka. As the result of their 
recommendation the following eighteen new Fellows of the Institute were elected 
by the Board of Directors: A. H. Copeland, J. H. Curtiss, J. F. Daly, C. %. Dieule- 
fait, H. F. Dodge, Churchill Eisenhart, Will Feller, Milton Friedman, M. A. 
Girschick, M. H. Hansen, P. G. Hoel, Tjalling Koopmans, A. M. Mood, L. J. 
Reed, L. I. Simon, F. F. Stephan, W. R. Thompson, and Jacob Wolfowivz. 

W. D. Baten, L. A. Aroian, I. W. Burr, and H. F. Dodge, at the request of the 
Board, continued to serve as a committee for securing additional library subserip- 
tions to the Annals. Programs for the New York and New Brunswick meetings 
were in charge of Vice-President Wald, and that for the Washington meeting was 
arranged by W. G. Madow. 

A proposal originating with Harold Hotelling that the Institute consider peti- 
tioning the Federal Government that the W. P. A. Computing Project be made a 
permanent computing group for the service of scientific research in the construe- 
tion of important numerical tables, was referred to a committee consisting of 
A. R. Crathorne, Chairman, P. 8. Dwyer, and Will Feller. As a result of their 
report, the Board appointed the following permanent committee on tabular 
computation, P. 8S. Dwyer, Chairman, Churchill Kisenhart, and Will Feller. — It 
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is expected that this committee will cooperate with representatives of other 
scientific organizations interested in tabular computation. 

The Nominating Committee for the recently held election of the Institute was 
A. T. Craig, Chairman, B. H. Camp, and J. H. Curtiss. G.W. Snedecor served 
the Institute as its representative on the Council of the American Association for 
the Advancement of Science. 

To all of those mentioned the Institute is indebted, and for the Board of Diree- 
tors I wish to thank them for their special contributions to the Institute. 

[ have reserved for particular mention the services of Vice-President Deming 
who was appointed by the Board the official representative of the Institute to deal 
with officials of the Selective Service Board in Washington relative to the defer- 
ment from military service of competent and experienced statisticians engaged 
in work important for the prosecution of the war. He gave much time and effort 
to this on his own initiative, and the Institute and all statisticians owe him much 
in that he has been very successful in convincing important Washington officials 
of the value of the services being rendered by good statisticians. 

In December the Board with deep regret accepted the resignation of E. G. Olds 
who was completing his third year as Secretary of the Institute. No member of 
the Institute will need to be reminded of the devotion and efficiency with which 
he filled his office. A mere comparative inspection of his annual reports would 
reveal to anyone otherwise uninformed how much the Institute owes to him. 
During his term of office the membership of the Institute has approximately 
doubled and the financial position of the Institute has been markedly improved 
in spite of war conditions. For both of these favorable circumstances he de- 
serves the greater part of the credit. In his present position as Chief Statistical 
Consultant with the Office of Production Research and Development of the 
War Production Board in association with Holbrook Working, he is still serv- 
ing the cause of statistics as well as the war effort. The Institute will greatly 
benefit by the intensive work these men are doing in educating industry in the 
uses of statistical methods in the control of quality in production. 

The annual election of the Institute just concluded by mail resulted in the elec- 
tion of the following officers for 1944: W. A. Shewhart, President; W. G. Cochran 
and Will Feller, Vice-Presidents; and P. 8. Dwyer, Secretary-Treasurer. Pro- 
fessor Dwyer had been appointed Acting Secretary-Treasurer upon the resigna- 
tion of Professor Olds. I need not remind the members of the Institute that the 
year 1944 remains critical for the Institute and that these new officers will need 
the fullest support. 

C. C. Craia, 
President, 1943. 
February 15, 1944. 
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REPORT OF SECRETARY-TREASURER 


ANNUAL REPORT OF THE SECRETARY-TREASURER OF THE 
INSTITUTE 


During 1943 three meetings of the Institute were held. On May 29, the Insti- 
tute met jointly with the American Society of Mechanical Engineers at the 
Engineering Societies Building in New York City, the program having been 
arranged by Abraham Wald and A. I. Peterson. A meeting consisting of three 
evening sessions was held on June 17-19, at George Washington University, 
Washington, D.C. William G. Madow made the necessary preparations for this 
meeting. On September 12-13, the Institute held its sixth summer meeting at 
New Jersey College tor Women, Rutgers University, New Brunswick, New 
Jersey. This meeting was held in conjunction with the summer meetings of the 
American Mathematical Society and the Mathematical Association of America,+ 
and the program was arranged by Abraham Wald. All three of these meetings 
were well attended. 

Early in the year a petition was granted for the establishment of a Pittsburgh - 
Chapter of the Institute. This organization, formerly known as the Society 
of Quality Control Statisticians, held its first meeting under the auspices of the 
Institute on June 19, and a second meeting was held on October 9. 

As recorded in an addendum to last year’s report, Vice-President I. L. Dodd 
died on January 9, 1943, and Dr. W. E. Deming was appointed to fill out the 
unexpired term. 

Professor H. L. Rietz died on December 7, 1943. A statement of appreciation 
for his work in mathematical statistics and in connection with the Institute has 
been prepared by Professor A. R. Crathorne and appears in the present issue 
of the Annals. ‘ 

The following financial statement covers a period from December 10, 1942, to 
December 21, 1943 (the books and records of the Treasurer have been audited 
by Paul S. Dwyer and found to be in agreement with the statement as sub- 
mitted): 


FINANCIAL STATEMENT 
December 10, 1942, to December 21, 1943 
RECEIPTS 


BALANCE ON Hanp, December 10, 1942 $2,155.13 


Raa os cic wetiniiee ta eek buNA es ROUEN ed oRe heed atdnemawatitics 2,640.62 
SUBSCRIPTIONS 1,631.67 
EE ee re ae eee ee 901.47 
ES RMN 2 0s De ese ns pa craw A KI i is aera le Bus 6.07 


Total Receipts $7 , 334.96 





INSTITUTE OF MATHEMATICAL STATISTICS 


I.xPENDITURES 
ANNALS OFPICE ... . 266 6k a 
WAVERLY PRESS 
Printing and Mailing Annals—4 issues. 
Back NUMBERS OFFICE 
Purchase of back numbers from H. C. Carver seas, le lee 
Reprinting 200 copies of Vol. VII, No. 1.. Saeaeiss. ne 


LIBRARY COMMITTEE bers 

SECRETARY-TREASURER’S OFFICE 
Printing and Supplies................ oe $135.00 
Binding... SEA emai 2.25 
Postage. ais eee et 135.77 
Clerical Help. ..... septa ses seaie ssace, Seka 


444,22 
PROGRAMS FOR MEETINGS..... ara Percy aD 44.22 
Boarp oF DIRECTORS....... Re 41.74 


MISCELLANEOUS. . 5.45 


Total Expenditures $3,619.91 


BALANCE ON Hanp, December 21, 1943.................. a Pere 3,715.05 


$7 , 334.96 
In comparison with the financial condition of the Institute at the end of 1942, 
the receipts from dues and subscriptions have increased nearly $700 and the 
proceeds from sales of back numbers have decreased nearly $500. In spite of 
increased prices, it was possible to reduce expenditures by approximately $800. 
Thus the Institute finds itself in a somewhat more favorable position than at the 
end of last year. 
Epwin C. OLps, 
Secretary-Treasurer. 
December 27, 1943. 


CONSTITUTION 
OF THE 
INSTITUTE OF MATHEMATICAL STATISTICS 


ARTICLE I 
NAME AND PURPOSE 


1. This organization shall be known as the Institute of Mathematical Statistics. 
2. Its object shall be to promote the interests of mathematical statistics. 


ARTICLE II 


MEMBERSHIP 


1. The membership of the Institute shall consist of Members, Junior Members, Fellows, 
Honorary Members, and Sustaining Members. 
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2. Voting members of the Institute shall be (a) the Fellows, and (b) all others, Junior 
Members excepted, who have been members for twenty-three months prior to the date of 
voting. 

3. No person shall be a Junior Member of the Institute for more than a limited term as 
determined by the Committee on Membership and approved by the Board of Directors. 


ARTICLE III 


OFFICERS, BoarD OF DIRECTORS, AND COMMITTEE ON MEMBERSHIP 


1. The Officers of the Institute shall be a President, two Vice-Presidents, and a Secre- 
tary-Treasurer. The terms of office of the President and Vice-Presidents shall be one year 
and that of the Secretary-Treasurer three years. Elections shall be by majority ballots at 
Annual Meetings of the Institute. Voting may be in person or by mail. 

(a) Exception. The first group of Officers shall be elected by a majority vote of the in- 
dividuals present at the organization meeting, and shall serve until December 31, 1936. 

2. The Board of Directors of the Institute shall consist of the Officers, the two previous 
Presidents, and the Editor of the Official Journal of the Institute. 

3. The Institute shall have a Committee on Membership composed of three Fellows. 
At their first meeting subsequent to the adoption of this Constitution, the Board of Di- 
rectors shall elect three members as Fellows to serve as the Committee on Membership, 
one member of the Committee for a term of one year, another for a term of two years, 
and another for a term of three years. Thereafter the Board of Directors shall elect from 
among the Fellows one member annually at their first meeting after their election for a 
term of three years. The president shall designate one of the Vice-Presidents as Chairman 
of this Committee. 


ARTICLE IV 
MEETINGS 


1. A meeting for the presentation and discussion of papers, for the election of Officers, 
and for the transaction of other business of the Institute shall be held annually at such 
time as the Board of Directors may designate. Additional meetings may be called from 
time to time by the Board of Directors and shall be called at any time by the President 
upon written request from ten Fellows. Notice of the time and place of meeting shall be 
given to the membership by the Secretary-Treasurer at least thirty days prior to the date 
set for the meeting. All meetings except executive sessions shall be open to the public. 
Only papers accepted by a Program Committee appointed by the President may be pre- 
sented to the Institute. 

2. The Board of Directors shall hold a meeting immediately after their election and 
again immediately before the expiration of their term. Other meetings of the Board may 
be held from time to time at the call of the President or any two members of the Board. 
Notice of each meeting of the Board, other than the two regular meetings, together with a 
statement of the business to be brought before the meeting, must be given to the members 
of the Board by the Secretary-Treasurer at least five days prior to the date set therefor. 
Should other business be passed upon, any member of the Board shall have the right to 
reopen the question at the next meeting. 








116 BY-LAWS 


3. The Committee on Membership shall hold a meeting immediately after the annual 
meeting of the Institute. Further meetings of the Committee may be held from time to 
time at the call of the Chairman or any member of the Committee provided notice of such 
vall and the purpose of the meeting is given to the members of the Committee by the 
Secretary-Treasurer at least five days before the date set therefor. Should other business 
be passed upon, any member of the Committee shall have the right to reopen the question 
at the next meeting. 

4. Ata regularly convened meeting of the Board of Directors, four members shall con- 
stitute a quorum. Ata regularly convened meeting of the Committee on Membership, 
two members shall constitute a quorum. 





































ARTICLE V 


PUBLICATIONS 





1. The Annals of Mathematical Statistics shall be the Official Journal for the Institute. 
The Editor of the Annals of Mathematical Statistics shall be a Fellow appointed by the 
Board of Directors of the Institute. The term of office of the Editor may be terminated at 
the discretion of the Board of Directors. 


2. Other publications may be originated by the Board of Directors as occasion arises. 


ARTICLE VI 
EXPULSION OR SUSPENSION 


1. Except for non-payment of dues, no one shall be expelled or suspended except by 
action of the Board of Directors with not more than one negative vote. 


ARTICLE VII 


AMENDMENTS 





1. This constitution may be amended by an affirmative two-thirds vote at any regularly 
convened meeting of the Institute provided notice of such proposed amendment shall have 
been sent to each voting member by the Secretary-Treasurer at least thirty days before the 
date of the meeting at which the proposal is to be acted upon. Voting may be in person or 
by mail. 


BY-LAWS 
ARTICLE I 


DvuTIES OF THE OFFICERS, THE Epitror, Boarp oF DirecTors, AND COMMITTEE ON MEM- 
BERSHIP 





1. The President, or in his absence, one of the Vice-Presidents, or in the absence of the 
President and both Vice-Presidents, a ellow selected by vote of the Fellows present, shall 
preside at the meetings of the Institute and of the Board of Directors. At meetings of the 
Institute, the presiding officer shall vote only in the case of a tie, but at meetings of the 
Board of Directors he may vote in all cases. At least three months before the date of the 
annual meeting, the President shall appoint a Nominating Committee of three members. 
It shall be the duty of the Nominating Committee to make nominations for Officers to be 
elected at the annual meeting and the Secretary-Treasurer shall notify all voting members 
at least thirty days before the annual meeting. Additional nominations may be sub- 
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mitted in writing, if signed by at least ten Fellows of the Institute, up to the time of the 
meeting. 

2. The Secretary-Treasurer shall keep a full and accurate record of the proceedings at 
the meetings of the Institute and of the Board of Directors, send out calls for said meetings 
and, with the approval of the President and the Board, carry on the correspondence of the 
Institute. Subject to the direction of the Board, he shall have charge of the archives and 
other tangible and intangible property of the Institute, and once a year he shall publish in 
the Annals of Mathematical Siatistics a classified list of all Members and Fellows of the 
Institute. He shall send out calls for annual dues and acknowledge receipt of same; pay 
all bills approved by the President for expenditures authorized by the Board or the Insti- 
tute; keep a detailed account of all receipts and expenditures, prepare a financial statement 
at the end of each year and present an abstract of the same at the annual meeting of the 
Institute after it has been audited by a Member or Fellow of the Institute appointed by the 
President as Auditor. The Auditor shall report to the President. 

3. Subject to the direction of the Board, the Editor shall be charged with the responsi- 
bility for all editorial matters concerning the editing of the Annals of Mathematical Sta- 
tistics. He shall, with the advice and consent of the Board, appoint an Editorial Commit- 
tee of not less than twelve members to co-operate with him; four for a period of five years, 
four for a period of three years, and the remaining members for a period of two years, ap- 
pointments to be made annually as needed. All appointments to the Editorial Com- 
mittee shall terminate with the appointment of a new Editor. The Editor shall serve as 
editorial adviser in the publication of all-scientific monographs and pamphlets authorized 
by the Board. 

4. The Board of Directors shall have charge of the funds and of the affairs of the In- 
stitute, with the exception of those affairs specifically assigned to the President or to the 


Committee on Membership. The Board shall have authority to fill all vacancies ad in- 
terim, occurring among the Officers, Board of Directors, or in any of the Committees. The 
Board may appoint such other committees as may be required from time to time to carry 
on the affairs of the Institute. 

5. The Committee on Membership shall prepare and make available through the Secre- 
tary-Treasurer an announcement indicating the qualifications requisite for the different 
grades of membership. 


ARTICLE II 
DvuES 


Members shall pay five dollars at the time of admission to membership and shall receive 
the full current volume of the Official Journal. Thereafter, Members shall pay five dol- 
larsannual dues. The annual dues of Junior Members shall be two dollars and fifty cents. 

The annual dues of Fellows shall be five dollars. The annual dues of Sustaining Members 
shall be fifty dollars. Honorary Members shall be exempt from all dues. 

(a) Exception. In the case that two Members of the Institute are husband and wife 
and they elect to receive between them only one copy of the Official Journal, the annual 
dues of each shall be three dollars and seventy-five cents. 

2. Annual dues shall be payable on the first day of January of each year. 

3. The annual dues of a Fellow, Member, or Junior Member include a subscription to the 
Official Journal. The annual dues of a Sustaining Member include two subscriptions to 
the Official Journal. 

4. It shall be the duty of the Secretary-Treasurer to netify by mail anyone whose dues 
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may be six months in arrears, and to accompany such notice by a copy of this Article. Jf 

such person fail to pay such dues within three months from the date of mailing such notice, 

the Secretary-Treasurer shall report the delinquent one to the Board of Directors, by whom 

the person’s name may be stricken from the rolls and all privileges of membership with. 

drawn. Such person may, however, be re-instated by the Board of Directors upon pay-} 
ment of the arrears of dues. 


ARTICLE III 


SALARIES 


1. The Institute shall not pay a salary to any Officer, Director, or member of any com- 
mittee. 


ARTICLE IV 


AMENDMENTS 


1. These By-Laws may be amended in the same manner as the Constitution or by a 
majority vote at any regularly convened meeting of the Institute, if the proposed amend- 
ment has been previously approved by the Board of Directors. 
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